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FOREWORD 

This  report  is  one  of  a  series  of  reports  dealing  with  the  development  of 
data  for  use  in  the  design  of  an  automated  LSO  training  system.  This  report 
describes  the  pilot,  aircraft  and  environment  model  from  a  functional  standpoint. 
The  report  is  Intended  for  two  audiences.  The  body  of  the  report  addresses  how 
the  study  was  conducted  and  is  Intended  for  researchers  who  want  to  verify  the 
methodology  of  the  study.  The  append  fees  contain  the  data.  The  software  model 
and  the  design  of  the  system  are  prc/ided  in  Appendix  E  and  F»  respectively. 

Thus,  the  system  builder  need  not  read  the  entire  rpport  to  find  the  informa¬ 
tion  of  interest  for  implementing  an  automated  LSO  training  system.  It  is 
Intended  that  this  division  of  the  report  into  a  "sc'entific"  section  and  a 
"data"  section  will  facilitate  Its  use  by  the  research  and  the  engineering 
communities,  and  aid  in  the  transfer  of  technology  from  the  laboratory  to  an 
operational  LSO  training  system. 

R.  BREAUX,  /h.D. 

Scientific  Officer 
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PREFACE 

The  authors  are  Indebted  to  many  Individuals  within  the  Landing  Signal 
Officer  (LSO)  community  who  contributed  their  valuable  time  and  ideas  to 
this  research  effort. 

LCDR  Jerry  Singleton,  who  at  the  time  was  the  LSO  Training  Model  Manager 
and  OinC  of  the  LSO  Phase  I  School,  was  extremely  valuable  as  a  subject  matter 
expert  and  as  a  coordinator  of  access  to  other  LSOs.  His  staff  assistants. 

Major  Ted  Lyons  and  LCDR  Earle  Rudolph  also  provided  valuable  assistance  to 
this  study. 

The  type  commander  LSOs  who  were  also  instrumental  in  assuring  compre¬ 
hensive  LSO  community  participation  in  various  aspects  of  the  study  included: 

LCDR  Bob  Day  and  LCDR  Frank  Roberts  of  COMNAVAIRLANT;  LCDR  Jerry  Arbiter  and 
LCDR  J.  R.  Davis  of  COMNAVAIRPAC;  and  LCDR  Fred  Jung  of  CNATRA. 

Dr.  Michael  Borowsky  and  Mrs.  Jo  Knott  provided  assistance  at  the  Naval 
Safety  Center  in  the  coordination  of  carrier  landing  accident  data  require¬ 
ments.  Dr.  Mike  McCauley  of  Canyon  Research  Group  provided  excellent 
technical  Interchange  between  this  study  and  his  parallel  effort  concerned 
with  instructor  model  functions  for  LSO  training  systems. 
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SECTION  I 


INTRODUCTION 


This  report  describes  the  activities  and  results  of  a  study  to  develop 
pilot  and  aircraft  behavior  models  for  Landing  Signal  Officer  (LSO) 
training  systems.  This  study  Is  one  in  a  series  of  research  efforts 
sponsored  by  the  Naval  Training  Equipment  Center  (NAVTRAEQUIPCEN)  to  apply 
advances  In  computer  technology  toward  the  Improvement  of  LSO  training. 


BACKGROUND 

A  major  problem  faced  by  the  Navy's  LSO  community  Is  a  shortage  of 
skilled  LSOs.  There  are  two  primary  causes  of  this  problem.  One  factor  has 
been  the  drastic  reduction  In  carrier  landing  operations  since  the  Vietnam 
conflict  ended.  On-the-job- training  (OJT)  aboard  ship  has  historically  been 
the  primary  medium  for  the  LSO  training  process.  Reductions  In  the  avala- 
blllty  of  this  medium  have  caused  a  lengthening  of  the  already  long  lear¬ 
ning  process  for  an  LSO  trainee.  A  promising  trainee  frequently  reaches  a 
fully  productive  skill  level  for  only  the  last  several  months  of  his  first 
sea  duty  tour  (a  three  year  period).  The  reduction  In  carrier  operations 
also  has  the  effect  of  reducing  exposure  of  LSOs  and  trainees  to  the  wide 
variety  of  job  conditions  for  which  they  must  be  prepared.to  handle.  There 
are  many  LSOs  and  supervisory  personnel  who  speculate  that  the  qualified 
LSOs  of  today  may  be  less  skilled  than  those  of  the  Vietnam  era.  The  other 
factor  has  been  a  significant  decrease  in  the  Navy  pilot  retention  rate. 
Since  pilot  qualification  Is  a  prerequisite  to  entering  LSO  training,  the 
pilot  retention  rate  also  reflects  the  availability  of  LSO  personnel  for 
experienced  LSO  billets,  such  as  those  In  Training  and  Fleet  Readme: 
Squadrons  and  Air  Wings.  This  impacts  LSO  training  in  that  there  is  a 
shortage  of  senior  LSOs  to  provide  guidance  and  Instruction  to  LSO 
trainees,  thus  reducing  the  quality  and  efficiency  of  the  training  program. 


Applications  of  simulation  technology  In  other  training  programs  have 
proved  very  successful  In  the  Improvement  of  Instructional  quality  and 
efficiency.  Recent  NAVTRAEQUIPCEN  research  studies  of  LSO  training  have 
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pointed  put  the  promising  potential  of  an  automated  LSO  training  sys¬ 
tem.'  .2, 3, 4  It  has  the  potential  to  Increase  LSO  trainee  exposure  to 
various  waving  situations,  to  decrease  dependency  on  Instructor  Interaction 
and  to  promote  task  performance  standardization.  In  developing  such  a 
system,  there  appears  to  be  minimal  technical  risk  Involved  with  the  simu¬ 
lation  aspects.  In  fact,  a  recently  procured  system,  the  LSO  Reverse  Dis¬ 
play,  which  Is  located  at  two  Navy  bases,  Is  proving  to  be  an  excellent 
simulation  for  support  of  LSO  training. 5  Its  major  limitation  is  Its 
dependency  on  instructor  availability  for  the  conduct  of  LSO  training.  This 
limitation  has  had  a  significant  negative  impact  on  recent  utilization  of 
the  device.  Therefore,  some  level  of  automated  Instructional  support  Is 
needed  to  maximize  the  benefits  of  an  LSO  training  system. 

The  study  which  Is  the  subject  of  this  report  addresses  the  modelling 
of  pilot  and  aircraft  behavior  as  a  part  of  automated  LSO  Instructional 
support. 


OVERVIEW 

The  purpose  of  this  effort  was  to  develop  a  functional  design  for 
models  of  pilot  and  aircraft  behavior  which  can  help  LSO  trainees  acquire 
perceptual  and  decision-making  skills  for  carrier  landing  operations.  A 
primary  objective  In  this  study  was  to  insure  that  the  models  would  be 
particularly  suited  to  the  representation  of  critical  waving  situations.  % 


1  Hooks,  J.T.,Butler,E.A.,  Gullen,  R.A.  and  Petersen,  R.J.,  Design 
Study  for  an  Auto-Adaptive  Landing  Signal  Officer  (LSO)  Training  System, 
TechnicaVireport,  NAVTRAEQUIPCEN  77-C-0 109-1,  Naval  Training  Equipment 
Center,  1978. 

2  Breaux,  R.,  (Ed.),  LSO  Training  RSD  Seminar  Proceedings,  Technical 
Report  IH-320,  Naval  Training  Equipment  Center,  1980. 

3  McCauley,  Michael  £.  and  Borden,  Gall  J.,  Computer-Based  Landing 
Signal  Officer  Carrier  A1 rcraft  Recovery  Model ,  Technical  Report,  NAVtRA- 
EQuiPCEN  77-C-0110,  Naval  Training  Equipment  Center,  1980. 

4  Hooks,  J.T.,  Butler,  E.A.,  Reiss,  M.J.  and  Peterson,  R.J~»  Landing 
Signal  Officer  (LSO)  Laboratory  System  Software,  Technical  Report,  NAVTRA¬ 
EQUIPCEN  78-C-0151^I.  Naval  Training  Equipment  Center,  1980. 

*  Hooks,  J.  Thel ,  McCauley,  Michael  E.,  Training  Characteristics  of  the 
LSO  Reverse  Display,  Technical  Report,  NAVTRAEQUTPCEN  79-C-U1U1-27  NavaT" 
Training  Equipment  Center ,  1980 . 
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Thus,  the  analytical  activities  were  focused  on  critical  aspects  of  LSO 
performance  and  carrier  landing  situations.  The  analytical  efforts  were 
Intended  to  result  In  the  Identification  of  key  LSO  learning  concepts  and 
training  situation  variables  on  which  to  base  model  development.  Another 
objective  in  the  study  was  to  identify  the  potential  cost  savings  which 
could  result  from  improved  LSO  training.  The  functional  design  effort  was 
intended  to  provide  guidance  for  detailed  software  design  of  the  models  and 
their  incorporation  in  an  automated  LSO  training  system.  In  pursuing  these 
objectives,  the  results  of  this  effort  were  also  expected  to  be  compatible 
with  automated  instructor  model  functions  being  addressed  in  another  LSO 
study  effort  sponsored  by  NAVTRAEQUIPCEN.6  Appendix  A  presents  a  summary 
of  the  technical  objectives  of  this  study,  progress  made  toward  their 
achievement  and  the  degree  to  which  they  were  met. 

Early  study  activities  included  the  review  of  many  documents  related 
to  LSO  performance,  carrier  landing  situations,  carrier  landing  accidents 
and  LSO  training  system  concepts.  This  review  provided  initial  data  and 

?u1 dance  for  subsequent  activities  which  included  a  survey  of  LSOs,  initial 
dentlf ication  of  situation  variables  and  key  LSO  learning  concepts,  and 
initial  formulation  of  pilot/aircraft  model  functions.  The  latter  stages  of 
the  study  involved  the  estimation  of  potential  cost  savings,  comprehensive 
analysis  of  carrier  landing  accidents,  the  iterative  refinement  of  key 
concepts  and  pilot/aircraft  models  and  the  development  of  a  functional 
design  for  the  models. 

The  results  of  analytical  activities  provide  very  comprehensive 
coverage  of  the  critical  aspects  of  successful  LSO  performance.  The  key 
concepts  presented  in  Appendix  D  extensively  describe  the  interrelation¬ 
ships  among  situation  cues,  decision  factors  and,  LSO  actions.  The  pi  .ot/- 
alrcraft  model  descriptions  presented  in  Appendix  E  are  a  comprehend .  ve 
compilation  of  the  variables  with  which  an  LSO  must  contend  in  carri  v 
landing  operations.  The  cost  savings  estimation  effort  described  in  Se. 
tlon  V  provides  insight  to  the  return  on  investment  for  procuring  iSG 
training  systems.  The  documentation  review  and  bibliography  provide  his¬ 
torical  perspective  for  the  emergence  of  automated  LSO  training  system 
concepts.  The  accident  analysis  presented  in  Appendix  G  shows  how  accident 
data  can  be  useful  in  LSO  training  program  design  and  quality  control. 
Appendix  H  suggests  improvements  for  interaction  between  the  LSO  Training 
Model  Manager  (TMM)  and  the  National  Safety  Center. 

Subsequent  portions  of  this  report  present  descriptions  of  study 
activities,  discussions  of  analytical  results  and  conclusions  and  recommen¬ 
dations  emerging  from  the  study.  The  primary  outputs  from  the  study  are 

r  resented  in  Appendix  E  (Pilot/Aircraft  Behavior  Models)  and  Appendix  F 
Functional  Design  for  Models). 


^McCauley,  M.E.,  and  Cotton,  J.C. 
Training  Systems.  Technical  Report,  NAi 
Equipment  Center,  1982. 
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SECTION  II 
APPROACH 

In  the  past  few  years  there  has  been  an  on-going  LSO  training  research 
proara*  at  the  NAVTRAEQUIPCEN.  The  early  efforts7,8  focused  on  LSO 
training  program  shortcomings  and  training  requirements,  LSO  "waving" 
behavior,  and  the  potential  functions  and  benefits  of  an  automated  LSO 
training  system.  More  recent  efforts  Involved  continued  analyst  >f  LSO 
"waving"  behavior.  Identification  of  LSO  performance  measures,  V  ratory 
Investigations  of  training  system  feasibility  and  field  evaluat  of  an 
LSO  training  device.9,10,11  These  activities  have  been  focuse  'n  the 
applicability  and  cost-effectiveness  of  advanced  technologies  for  1  cvlng 
the  LSO  training  program. 

The  most  recent  efforts.  Including  the  one  reported  herein,  involved 
the  design  of  modelling  functions  to  operate  within  an  automated  LSO 
training  system.  One  set  of  functions  Is  Intended  to  represent  pilot  and 
aircraft  behavior  for  simulated.  Interactive  waving  situations  for  the  LSO 
trainee.  The  other  set  of  functions  Is  intended  to  provide  Instructor 
support  In  the  conduct  of  tralnlng.12  This  support  Is  to  encompass  sylla¬ 
bus  decisions,  trainee  performance  assessment  and  other  Instructor  aids 
needed  for  effective  utilization  of  an  automated  LSO  training  system. 


7  Hooks,  J.T., Butler, E.A.,  Gullen,  R.A.  and  Petersen,  R.J.,  Design 
Study  for  an  Auto-Adaptive  Landing  Signal  Officer  (LSO)  Training  System, 
YecnnfcalTfeport,  NAVTRAEQUIPCEN  77-C-01Q9-1,  Naval  Training  Equipment 
Center,  1978. 

8  McCauley,  Michael  E.  and  Borden,  Gall  J.,  Computer-Based  Landing 
Signal  Officer  Carrier  Aircraft  Recovery  Model,  Technical  Report",  NaVTRA- 
eQuipCEN  77-C-0110,  Naval  Training  Equipment  Center,  1980,  (In  press). 

9  Brlctson,  C.A.,  Breldenbach,  S.T.,  Narsete,  E.M.,  Pettigrew,  K.M., 
Objective  Measures  of  Landing  Signal  Officer  (LSO)  Performance  During  Night 
£arr7er  Reco7ery~  Technical  Hep NlkYTR AIWPCFNT8 ffavaT 
Training  Equipment  Center,  1980. 

10  Hooks,  J.T.,  Butler,  E.A.,  Reiss,  M.J.  and  Peterson,  R.J.,  Landing 
Signal  Officer  (LSO)  Laboratory  System  Software,  Technical  Report,  Navtra- 
EQUIPCEN  78-0-0151-1,  Naval  Training  Equ1pm#nt‘“fcenter,  1980. 

11  Hooks,  J.  Thel,  McCauley,  Michael  E.,  Training  Characteristics  of  the 
LSO  Reverse  Display,  Technical  Report,  NAVTRAtOuiPCEN  79-C-0101-2,  Naval 
TFalnlng  Equipment  center,  1980. 

^  McCauley,  M.E.,  and  Cotton,  J.C.  Automated  Instructor  Models  for  LSO 
Training  Systems,  Technical  Report,  NAVTRAEQUIPCEN  B0-f^(5073-l ,  Naval  Trainina 
Equipment  Center,  1982. 
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The  subject  of  this  report  Is  the  development  of  pilot/aircraft  models 
and  the  design  of  system  functions  for  their  incorporation  in  an  automated 
LSO  training  system.  This  section  of  the  report  describes  the  approach 
which  was  proposed  and  followed  in  the  execution  of  the  study. 


LSO  INSTRUCTIONAL  CONTROL  CONCEPTS 

Automated  instructional  control  in  an  LSO  training  system  encompasses 
the  process  of  managing  the  learning  experience  of  an  LSO  trainee.  There 
are  several  elements  involved  in  accomplishing  the  instructional  control 
process.  Figure  1  is  a  simplified  representation  of  an  automated  LSO 
training  system  which  shows  the  conceptual  relationships  of  these  elements. 
The  instructor  model  can  be  viewed  as  the  system  executive:  collecting  and 
evaluating  data,  making  instructional  decisions  or  providing  recommenda¬ 
tions  to  the  human  instructor,  providing  instructional  feedback  to  the 
trainee,  directing  training  exercise  generation,  informing  the  instructor 
of  trainee  performance  results  and  storing  trainee  performance  data.  Thus, 
a  simple  instructor  console,  perhaps  only  a  CRT,  is  all  that  is  required  in 
an  automated  training  system. 

Automated  instructional  control  should  support  both  instructor-present 
and  instructor-absent  modes  of  training.  Instructor-presznt  training  is 
necessary  due  to  the  significant  level  of  subjectivity  involved  in  several 
aspects  of  LSO  task  performance.  Some  time  in  the  future  most  of  this 
subjectivity  may  become  quantifiable.  However,  for  the  near  future,  human 
instructor  judgment  must  remain  a  part  of  the  LSO  training  process  and 
automated  instructor  support  can  enhance  the  efficiency  of  the  instructor- 
present  mode  of  training.  On  the  other  hand,  instructor-absent  training  is 
also  an  important  aspect  of  LSO  training  system  effectiveness.  Inadequate 
availability  of  instructor  LSOs,  as  was  mentioned  earlier,  can  minimize  ta, 
potential  benefits  of  an  LSO  training  system.  Valuable  capabilities  assc 
dated  with  an  Instructor-absent  mode  of  training  include  provisions  for 
auto-adaptive  Instruction  in  selected  sy.labus  segments  which  are  amenable 
to  objective  performance  assessment,  and  self-paced  trainee  practice  ses¬ 
sions  for  review,  remediation  and  additional  experience. 


The  need  for  exercise  generation  and  control  to  support  instructor- 
absent  training  Is  fairly  obvious.  As  Figure  1  Implies,  this  is  the  mecha¬ 
nism  utilized  by  the  Instructor  model  function  to  Implement  instructional 
decisions  relevant  to  the  trainee  skill  level.  For  instructor-present 
training  it  supports  training  session  efficiency  by  minimizing  instructor 
task  loading.  The  exercise  generation  and  control  function  interacts  with 
the  simulation  portion  of  the  training  system  to  provide  the  trainee  with 
the  required  conditions  for  skill  acquisition  and  practice. 
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SIMULATION 


Figure  1.  LSO  Training  System  Concept 
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APPROACH 

Mathetics  proposed  and  executed  a  systematic  data  gathering  and 
analysis  approach  leading  to  the  development  of  pllot/alrcraft  behavior 
models  and  their  functional  design.  The  approach  Involved  parallel  perfor¬ 
mance  of  training  analysis  and  model  function  design  efforts,  as  well  as 
Interaction  with  the  Canyon  Research  Group  Instructor  model  functional 
design  project.  The  approach  Is  depicted  In  Figure  2.  The  Initial  project 
activity  was  a  planning  effort  which  resulted  In  the  formulation  and  docu¬ 
mentation  of  a  work  plan.  This  plan  was  formulated  In  liaison  with  Canyon 
Research  Group  to  clarify  the  Interaction  requirements  between  the  two 
related  studies.  The  work  plan  established  personnel  and  task  scheduling, 
data  sources,  anticipated  analyses,  liaison  with  the  LSO  community  and 
expected  results  of  study  activities. 

The  Initial  training  analysis  effort  Involved  the  review  of  documenta¬ 
tion  relevant  to  LSO  task  performance.  Data  sources  Included  technical 
reports,  safety  journals  and  descriptions  of  recent  carrier  landing  acci¬ 
dents.  These  activities  resulted  In  the  identification  of  critical  LSO 
skill  areas  and  associated  job  conditions. 

The  Initial  functional  design  effort  involved  the  review  of  technical 
reports  concerning  LSO  training  system  concepts.  This  effort  led  to  the 
formulation  of  a  top-level  automated  LSO  training  system  structure  and  the 
Initial  definition  of  pllot/alrcraft  behavior  model  functions  within  the 
structure.  This  effort  included  liaison  with  the  Instructor  model  study 
personnel . 

The  second  training  analysis  effort  included  the  collection  and  analy¬ 
sis  of  additional  LSO  task  performance  data  gathered  through  survey  of  the 
LSO  community.  The  focus  In  this  effort  was  upon  critical  waving  situa¬ 
tions  and  variables  which  had  been  identified  In  the  earlier  analysis 
phase.  The  results  of  this  effort  provided  initial  inputs  to  the  pilot/air¬ 
craft  behavior  modelling  effort  and  established  an  Initial  basis  for  the 
Identification  of  key  LSO  learning  concepts. 

The  next  step  Involved  the  Identification  of  pllot/alrcraft  behavior 
model  requirements.  The  waving  conditions  and  situations  mentioned  above 
were  segmented  Into  related  groups  of  Instructional  variables.  Groupings 
were  established  as  the  basis  for  development  of  separate  models* and  model 
elements  for  the  pilot  and  the  aircraft.  Other  variables  were  also 
organized  Into  groupings  to  account  for  environmental  and  operational 
conditions  needed  for  LSO  training  exercises.  This  was  an  Iterative  effort 
over  time  during  the  study  as  variables  were  added  and  groupings  were 
revised. 

Based  on  the  model  requirements  mentioned  above,  functions  were 
identified  for  their  Interaction  within  the  exercise  generation  and  control 
process  for  the  system.  The  descriptions  of  the  functions,  their 
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Interrelatlonsips  and  other  considerations  which  resulted  from  this  effort 
formed  an  Initial  iteration  of  the  functional  design  for  the  pilot/aircraft 
behavior  model  functions. 

The  next  training  analysis  activity  Involved  the  formulation  of  key 
ISO  learning  concepts  from  the  task  performance  and  situation  data  gathered 
and  analyzed  earlier.  This  was  an  Iterative  effort  which  included  periodic 
liaison  and  review  of  results  with  the  LSO  Training  Model  Manager  and  other 
LSOs.  The  key  concepts  are  primarily  Intended  to  provide  the  foundation  of 
LSO  training  emphasis  upon  critical  decision  aspects  of  the  waving  task. 
They  are  specified  In  terms  of  decision  Influences  and  relationships,  and 
"rule-of-thumb"  guidance  for  critical  situations.  As  such  they  are  Impor¬ 
tant  Influences  on  syllabus  design  and  control.  Therefore,  there  was 
Interaction  with  Canyon  Research  Group  concerning  LSO  training  requirements 
and  the  syllabus  decisions  aspect  of  the  instructor  model  study. 

At  this  stage  of  the  study  most  of  the  Information  was  available  for 
the  development  of  the  pilot/aircraft  behavior  models.  This  effort  Involved 
the  specification  of  model  elements  and  sub-elements,  their  attributes  and 
values,  and  their  functional  Interrelationships  to  form  exercise  scenarios 
responsive  to  LSO  training  requirements.  The  primary  emphasis  In  this  effort 
was  upon  models  of  pilot  and  aircraft  behavior.  However,  the  environmental 
and  operational  elements  of  exercise  scenarios  were  also  addressed.  Liaison 
with  Canyon  Research  Group  and  the  LSO  Training  Model  Manager  was  a  part  of 
this  activity. 

/ 

The  final  step  In  the  training  analysis  portion  of  the  study  was  the 
estimation  of  the  potential  cost  savings  which  could  accrue  from  automated 
LSO  training  system  utilization.  This  analysis  focused  on  the  potential 
benefits  of  the  system  relative  to  LSO  performance  In  carrier  landing 
accident  situations.  Judgments  of  skill  and  training  program  deficiencies 
In  accident  situations  were  obtained  from  experienced  LSOs  and  analyzed  In 
conjunction  with  anticipated  training  capabilities  and  accident  costs  to 
estimate  potential  cost  savings. 

The  final  step  was  the  translation  of  the  pilot/aircraft  behavior 
models  Into  a  design  of  software  functions  for  Implementation  of  the  models 
Into  the  system.  The  functional  design  evolved  from  a  top-down  hierarchical 
approach.  There  was  significant  Interaction  with  the  Canyon  Research  Group 
effort  to  ensure  comprehensive  definition  of  interfaces  with  all  aspects  of 
the  system.  Including  the  Instructor  model  functions. 

Subsequent  sections  of  this  report  provide  additional  detail  concer¬ 
ning  specific  activities  within  this  approach  and  their  results.  Section 
III  reviews  documentation.  Section  IV  reviews  the  survey  data.  Section  V 
reviews  the  costing  and  accident  data  collected  from  the  Naval  Safety 
Center.  The  remaining  sections  address  the  Integration  and  correlation  of 
data  to  formulate  pilot/aircraft  modelling  concepts  and  functions. 
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SECTION  III 
DOCUMENTATION  REVIEW 

Early  In  this  project,  a  review  of  documentation  relevant  to  LSO 
training,  LSO  training  system  concepts,  and  carrier  landing  operations  was 
conducted.  The  purposes  of  this  activity  were  two  fold.  Literature  rele¬ 
vant  to  LSO  training  system  concepts  was  reviewed  to  Insure  that  pilot/ 
aircraft  modelling  function  designs  would  be  compatible  extensions  of  In¬ 
structional  concepts  derived  In  earlier  studies.  The  other  purpose  of  the 
review  was  to  provide  Initial  guidance  In  the  Identification  of  particu¬ 
larly  critical  aspects  of  the  LSO  waving  task.  The  remainder  of  this 
section  will  describe  the  review  In  two  segments:  LSO  training  system 
concepts,  and  critical  LSO  skills  and  conditions.  Within  each  segment, 
relevant  Information  reviewed  and  Its  Impl Icatlons  for  pilot/aircraft  model¬ 
ling  function  design  will  be  discussed. 

LSO  TRAINING  SYSTEM  CONCEPTS 

The  original  basis  for  an  LSO  training  system  was  promoted  by  a  Navy 
fleet-generated  operational  requirement  (0.R.1  proposal  for  an  LSO  training 
device  called  Carrier  Aircraft  Recovery  Simulator  (CARS). 13  It  was  sug¬ 
gested  that  this  device  provide  extensive,  high  fidelity  simulation  of  the 
carrier  recovery  environment  from  the  LSO  platform  perspective.  Some  of  the 
features  proposed  Included:  recovery  visual  scene,  LSO/pIlot  Interaction, 
multiple  aircraft  simulation,  full  LSO  workstation  Instrumentation,  sound 
effects,  aircraft  malfunctions,  and  environmental  effects  (Including  deck 
motion).  The  prevailing  rationale  supporting  the  need  for  CARS  was  that 
LSO  trainees  were  not  receiving  adequate  waving  experience  due  to  a  signi¬ 
ficant  reduction  In  carrier  operating  tempo  following  the  Vietnam  conflict. 

NAVTRAEQUIPCEN  subsequently  sponsored  research  Into  the  definition  and 
feasibility  of  developing  an  LSO  training  system.  Extensions  beyond  the 
basic  CARS  design  which  evolved  from  an  Initial  design  study  were  automated 
LSO  performance  evaluation  (using  automated  speech  recognition)  and  auto¬ 
mated  adaptive  syllabus  control. 14  The  results  of  the  Initial  design  study 
which  are  relevant  to  the  development  of  pllot/alrcraft  behavior  models 
Included: 

LSO  job  tasks  and  conditions  descriptions 
definition  of  LSO  training  system  functional  concepts 
potential  roles  of  an  LSO  training  system 

-  syllabus  content  and  sequence  guidance 
technology  assessment 

13  U.S.  Navy,  Carrier  Aircraft  Recovery  Simulator  (CARS)  proposal 
letter,  VAQ-129  NAS  Whldbey  Island,  Washington,  May  26,  1976. 

14  Hooks,  J.T.,  Butler,  E.A.,  Gullen.R.A.  and  Petersen,  R.J.,  Design 
Study  for  an  Auto-Adaptive  Landing  Signal  Officer  (LSO)  Training  System, 
TFZTmnm “Report,  NAVTRAEQUrFCEN  77- C-Ol  09-  TT^a  vaTTra  1'n'l ng'Tqu i pment 
Center,  1978. 
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A  concurrent  NAVTRAEQUIPCEN  program  was  underway  to  develop  a  model  of  LSO 
behavior  to  support  automated  performance  evaluatlon.15  This  resulted  In 
the  Increased  awareness  of  the  perceptual  and  decision-making  complexities 
of  waving  aircraft.  Additionally,  It  provided  an  Initial  quantification  of 
aircraft  approach  dynamics  associated  with  the  use  of  LSO  voice  calls. 

During  the  same  time  frame,  an  effort  was  underway  by  the  Vought 
Corporation,  under  Naval  Air  Systems  Command  sponsorship,  to  develop  an  LSO 
training  station  for  the  A-7E  Night  Carrier  Landing  Trainer  (NCLT1.16  This 
device,  called  the  LSO  Reverse  Display  (LSORD),  incorporated  some  of  the 
features  suggested  for  CARS,  but  simulated  only  the  A-7  aircraft  and  was 
dependent  upon  Interface  with  the  NCLT  for  LSO/pllot  Interaction.  Following 
the  operational  deployment  of  this  device  to  NAS  Lemoore  and  NAS  Cecil 
Field,  NAVTRAEQUIPCEN  Initiated  a  training  effectiveness  evaluation.  The 
results  of  this  evaluation  were  favorable  but  Indicated  a  need  for  opera¬ 
ting  Independence  from  the  NCLT  and  for  enhancement  of  device  capabili¬ 
ties. 17  In  general,  the  study  suggested  that  capabilities  resembling  those 
of  CARS  and  those  suggested  from  the  first  NAVTRAEQUIPCEN  study  would 
provide  a  higher  payoff  In  LSO  training  effectiveness. 

As  the  LSORD  was  being  evaluated,  two  other  NAVTRAEQUIPCEN- sponsored 
programs  were  underway.  One  involved  the  laboratory  development  and  demon¬ 
stration  of  an  automated  LSO  training  system. 18  This  system  exercised 
automated  speech,  performance  measurement,  and  training  feedback  for 
limited  LSO  waving  skills.  This  system  also  employed  pre-defined  waving 
scenarios  tied  to  specific  learning  goals.  There  were  positive  Indications 
for  the  feasibility  of  the  automated  concepts  which  were  Investigated. 
However,  training  effectiveness  was  not  validated.  The  other  NAVTRAEQUIP- 


McCauley,  Michael  E.  and  Borden,  Gall  J.,  Computer-Based  Landing 
Signal  Officer  Ca nr 1  er  Aircraft  Recovery  Model ,  Technical  Report  NAVTrA- 
EQuIPCEN  77-C-0110,  Naval  training  Equipment  Center,  1980  (in  press). 

16  Lacy,  J.W.  and  Meshler,  C.W.,  Development  of  a  Landing  Signal 
Officer  Trainer,  Proceedings,  First  Interservice/Industry  Training  Equip¬ 
ment  Conference  ,  Technical  Report,  NAVTRAEQUIPCEN  lH-316,  Naval  Training 
Equipment  Center,  1979,  79-90. 

^  Hooks,  J.  Thel  and  McCauley,  Michael  E.,  Training  Characteristics  of 
the  LSO  Reverse  Display,  Technical  Report,  NAVTRArQIltTCEN  79-C-OTU1-ZT 
Waval  Training  Equipment  Center,  1980. 

Hooks,  J.  Thel,  Butler,  E.A.,  Rless,  M.J.  and  Petersen,  R.J., 
Landing  Signal  Officer  (LSO)  Laboratory  System  Software,  Technical  Report, 
NAVTrXequipCEN  78-C-Ol 5l -1 ,  Naval  Training  Equipment  Center,  1980. 
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CEN~ sponsored  program  Involved  an  analysis  of  historical  carrier  landing 
data  to  Identify  candidate  measures  of  LSO  performance.19  The  results  of 
this  effort  showed  the  potential  of  carrier  landing  results  as  Indicators 
of  LSO  performance  quality. 

NAVTRAEQUIPCEN  also  sponsored  several  other  research  efforts  which 
were  not  directly  related  to  LSO  training  but  are  relevant  to  automated  LSO 
training  system  design.  One  was  the  development  of  a  Precision  Approach 
Radar  Controller  training  system,  which  employs  automated  speech  recogni¬ 
tion,  syllabus  control,  and  performance  evaluatlon.20  Another  was  the  deve¬ 
lopment  of  an  Air  Intercept  Controller  training  system,  with  similar  capa¬ 
bilities,  but  with  more  complex  training  sltuatlons.21  Two  other  studies 
Involved  research  Into  adaptive  syllabus  control  and  automated  instructor 
concepts .22 ,23  These  are  primarily  relevant  to  development  of  an  automated 
Instructor  model  for  the  LSO  training  system. 

A  seminar  was  sponsored  by  NAVTRAEQUIPCEN  In  January  1980  on  the  topic 
of  LSO  Training  RAD.  The  papers  presented  at  that  seminar  provide  an 
overview  of  NAVTRAEQUIPCEN  research  efforts  In  support  of  LSO  training 
system  design.24 


19  Brlctson,  C.A.,  Breldenbach,  S.T.,  Narsete,  E.H.,  Pettigrew,  K.W., 
Objective  Measures  of  Landing  Signal  Officer  (LSO)  Performance  During  Night 
Carrier  "Recovery, Technical  Report,  NAVTRAEQUIPCEN  78-C-0123-1,  Naval 
Training  Equipment  Center,  1980. 

20  McCauley,  Michael  E.,  and  Semple,  Clarence  A.,  Precision  Approach 
Radar  Training  System  (PARTS)  Training  Effectiveness  Evaluation,  Technical 
Report,  NAVTRAEQUIPCEN  79-C-0042-1,  Naval  Training  Equipment  Center,  1980. 

21  Halley,  Robin,  King,  M.R.  and  Regelson,  E.C.,  Functional  Requirement 
for  Air  Intercept  Controller  Prototype  Training  System,  Technical  Report, 
NWTfiXEQUIPdM ^-OTrB2-4rHaval  Training  Eq'ul pmenfTenter,  1980. 

22  Chatfleld,  Douglas  C.  and  Gldcumb,  Charles  F.,  Optimization  Technl - 
ques  For  Automated  Adaptive  Training  Systems,  Technical  Report,  NAVTRA- 
tQUIPCnr  77-M-057S,  Naval  Training  Equipment  tenter,  1977. 

23  Chatfleld,  Douglas  C.,  Marshall,  P.H.,  and  Gldcumb,  C.F.,  In- 
structor  Model  Characteristics  for  Automated  Speech  Technology  (IMCAST), 
Technical  Report,  NAVTRAEQUIPCEN"79-C-008S-1,  Naval  Training  Equipment 
Center,  1979. 

2*  Breaux,  R.,  (Ed.),  LSO  Training  RAD  Seminar  Proceedings,  Technical 
Report  IH-320,  Naval  Training  Equipment  Center,  1980. 
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The  reports  referenced  above  Influenced  early  activities  associated 
with  definition  of  Interactions  of  the  pilot/aircraft  modelling  functions 
within  the  automated  LSO  training  system.  They  continued  to  serve  as  pri¬ 
mary  references  as  this  project  progressed  to  completion.  They  should  also 
be  considered  valuable  references  in  the  future  development  and  implementa¬ 
tion  of  an  LSO  training  system. 


CRITICAL  SKILLS  AND  CONDITIONS 


Some  of  the  reports  mentioned  earlier  were  also  good  sources  of  criti¬ 
cal  skills  and  waving  conditions  ^formation.  Other  technical  reports  and 
recent  Approach  magazine  articles  (past  eight  years)  were  also  valuable 
sources'.  Summaries  of  recent  carrier  landing  accidents  were  reviewed  to 
provide  more  specific  operational  indications  of  critical  LSO  skills  and 
Job  performance  conditions. 

Several  technical  reports  provided  comprehensive  descriptions  of  LSO 
waving  tasks  and  conditions. 25, 26, 27  These  references.  In  many  cases,  were 
explicit  In  highlighting  the  more  critical  aspects  of  waving.  The  waveoff 
declson  was  the  LSO  task  receiving  the  most  attention.  Night,  pitching 
deck.  Manually  Operated  Visual  Landing  Aid  System  (MOVLAS),  wind  and  no 
horizon  were  among  the  conditions  most  frequently  noted.  An  old  article 
from  Approach  provided  a  comprehensive  examination  of  basic  pilot  carrier 
landing  tec hnl ques ,  typical  errors  and  error  trends  and  effective  pIlot/LSO 
Interaction. 28  Most  environmental  factors  were  also  discussed.  One  very 
experienced  LSO  provided  excellent  Insight  to  some  of  the  psychological 
implications.^  waving  and  the  Interrelationships  between  LSO  and  pilot  In 
the  LSO  Job.29 


25  Borden,  G.J.,  The  Landing  Signal  Officer:  A  Problem  Analysis,  Vols. 
I,  II.  Technical  Report  785-1,  Goleta,  Calif.:  Human  Factors  Research, 
Inc.,  May  1969. 

26  Hooks,  J.T.,  Butler,  E.A.,  Gullen,  R.A.  and  Petersen,  R.J.,  Design 
Study  for  an  Auto-Adaptive  Landing  Signal  Officer  (LSO)  Training  System. 
Technical  “Report,  NAvTRAEQUIPCfeN  W-C-0109T,  Naval  Training  Equipment 
Center,  1978. 

27  McCauley,  Michael  E.  and  Borden,  Gall  J.,  Computer-Based  tending 
Signal  Officer  Carrier  Aircraft  Recovery  Model ,  Technical  Report  NaVTRa- 
EUOIPCEN  77-C-OllO,  Naval  Training  Equipment  Center,  1980  (In  press). 

28  Netherland,  R.M.,  The  Total  Approach,  Approach.  Naval  Safety 
Center,  1965. 

29  Rubel,  Robert  C.,  Confessions  of  a  CAG  LSO,  Approach,  Naval  Safety 
Center,  1980. 
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Excellent  discussion  of  the  waveoff  was  found  In  one  art1c1e30  and  an 
LSO  reference  Manual .31  The  reference  manual  also  covered  a  broad  spectrum 
of  operational  (lens,  wires  mlssina  MOVLAS,  etc.)  and  environmental  factors 
(wind-over-deck,  deck  motion)  critical  to  successful  waving  performance. 
Another  paper  which  was  reviewed,  addressed  environmental  factors  In  car¬ 
rier  landing  accldents.32  Pitching  deck  and  no  horizon  were  Identified  as 
the  most  significant  factors.  The  F-4  aircraft  was  Identified  as  most 
susceptible  to  accidents  under  pitching  deck  conditions. 

MOVLAS  was  the  topic  of  three  articles  reviewed. 33, 34, 35  These  pro¬ 
vided  excellent  Insight  Into  the  effective  use  of  MOVLAS  and  the  need  for 
Increased  MOVLAS  training  emphasis.  Pilot  factors  were  the  subject  of  four 
other  articles.  One  emphasized  that  even  the  "best"  pilot  can  have  a  bad 
approach.36  Another  pointed  to  the  relatively  high  accident  potential  of 
the  Inexperienced  pllot.37  Two  articles  provided  examples  of  degraded 
approach  performance  by  pilot.  In  one  case  the  pilot  was  distracted  by 
unexpected  mission  changes  and  negatively  Influenced  by  a  "Can  Do"  atti¬ 
tude. 38  In  the  other  case  the  pilot  had  to  fly  a  night  approach  with 
degraded  vision  due  to  11ghtn1ng.39  One  article  described  a  situation  In 
which  a  timely  LSO  call  to  an  aircraft  on  CCA  (1-1/2  miles)  prevented  the 


30  Webb,  6.J.,  The  In-Close  Waveoff.  Approach,  Naval  Safety  Center, 

1976.  - 

31  Erickson,  D.P.,  Landing  Signal  Officer  Guide  and  Training  Plan, 
circa  1978. 

32  Brlctson,  C.A.,  The  Influence  of  Environmental  Factors  In  Aircraft 
Carrier  Landing  Accidents,  Conference  Proceedings  No.  82  on  Adaptation  and 
Acclimatisation  In  Aerospace  Medicine,  AGARD,  September  1970. 

33  Whalen,  Dan,  Rig  the  MOVLAS,  Starboard  Side,  Approach,  1976. 

34  Mears,  Mike,  MOVLAS  Techniques  for  Pilots  and  LSOs,  Approach, 
Naval  Safety  Center,  1976. 

3®  Naval  Safety  Center,  Ask  Any  Centurion,  Approach,  1979. 

36  Naval  Safety  Center,  It  Happens  to  the  Best,  Approach,  1977. 

37  Borowsky,  Michael  S.,  Barrett,  Gloria  B.,  Beck,  Art,  Gaynor,  John, 
Aviation  Safety  vs.  Pilot  Experience,  Approach,  Naval  Safety  Center,  1980. 

^  Hoggart,  F.A.,  Night  Tanker,  Approach,  Naval  Safety  Center,  1980. 

39  Franken,  D.J.,  Oh  What  a  Night!,  Approach.  Naval  Safety 
Center, 1981. 
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pilot  from  flying  Into  the  water.4Q  A  final  article  addressed  the  dif¬ 
ficulties  associated  with  a  low  .vislbll  ity  landing  and  LSO  problems  In 
perceiving  late  lineup  deviations. 

The  accident  review  portion  of  this  activity  utilized  Naval  Safety 
Center  computer  printout  summaries  of  63  accidents  which  occurred  between 
January  19/4  and  January  1980.  The  purpose  of  this  review  was  to  Identify 
factors,  variables  and  trends  within  accident  situations  which  appear 
particularly  critical  to  successful  LSO  performance.  The  results  of  this 
review  are  discussed  In  subsequent  paragraphs. 

Pilot  and  other  factors  were  cited  as  causes  In  the  majority  of  acci¬ 
dents  reviewed.  There  were  twenty  cases  In  which  material  failures  of 
aircraft  or  ship  systems  were  cited  and  no  blame  was  attributed  to  the  LSO. 
However,  performance  of  the  LSO  was  cited  as  a  cause  factor  In  more  than 
one-third  of  the  accidents  reviewed.  In. the  majority  of  these  cases,  he  was 
cited  for  failure  to  give  a  timely  waveoff.  The  large  number  of  ramp  strike 
and  hard  landing  outcomes  are  also  Indicative  of  waveoff  performance  criti¬ 
cality.  These  outcomes  plus  the  occurrence  of  Inflight  and  off-center 
engagements  are  Indicative  that  general  LSO  performance  within  the  "In 
close"  portion  of  an  approach  Is  particularly  critical.  There  were  several 
Instances  of  late  waveoffs  leading  to  Inflight  engagements.  The  off-center 
engagements  In  most  cases  were  Indicative  of  poor  LSO  attention  to  lineup 
deviations.  Better  use  of  "Power"  and  "Attitude"  calls  could  have  minimized 
the  occurrence  of  ramp  strike/hard  landing  outcomes.  There  also  appeared  to 
be  a  tendency  for  many  LSOs  to  wait  until  the  "In  close"  area  to  resolve 
approach  deviations.  Another  observation  from  the  review  was  an  apparent 
deficiency  In  the  teamwork  displayed  by  LSOs  on  the  platform.  There 
appeared  to  be  a  need  for  more  active  Involvement  by  the  back-up  LSO, 
especially  In  situations  with  difficult  environmental  conditions  or  with 
multiple  approach  deviations  "In  close." 

F-4  and  A-7  were  the  aircraft  most  frequently  Involved  In  accidents 
during  this  period.  This  was  not  surprising  due  to  the  fact  that  these  two 
types  had  more  carrier  landings  during  the  period.  What  was  Interesting 
from  an  LSO  training  standpoint  Is  that  the  majority  of  F-4  accidents  were 
the  result  of  hard  landings.  The  excellent  power  response  of  the  F-4  seems 
to  have  turned  many  potential  ramp  strikes  Into  hard  landings.  For  the  A-7, 
the  majority  of  accidents  Involved  ramp  strikes,  which  may  be  attributable 
to  Its  relatively  poor  power  response.  These  and  other  aircraft  accident 
outcome  trends  and  performance  characteristics  are  indicative  of  their 
criticality  to  successful  LSO  performance. 


Heyworth,  Gordon,  Touch-and-Go  With  the  Grim  Reaper,  Approach, 
Naval  Safety  Center,  1980. 

Logan,  Robert  J.,  Paddles  Contact  -  You're  Looking  Good,  Keep  It 
Coming,  Approach,  Naval  Safety  Center,  1980. 
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Another  important  result  of  this  review  was  the  identification  of 
other  conditions  which  appear  frequently  In  accident  situations.  As  men¬ 
tioned  earlier,  the  pilot  Is  the  most  frequently  cited  accident  cause 
factor.  From  the  accident  review,  there  appears  to  be  some  predictability 
of  pilot  Influence  in  accident  situations.  The  primary  factor  identified 
was  that  of  low  pilot  experience,  a  factor  which  was  also  noted  In  an 
article  discussed  earlier.  The  track  record  of  pilot  landing  skill,  inclu¬ 
ding  pilot  responsiveness  to  the  LSO,  was  also  Identifiable  In  the  review 
as  a  frequent  factor  in  accidents.  The  pilot  approach  trend  that  was  most 
apparent  In  leading  to  accidents  was  one  in  which  the  aircraft  had  a  high 
deviation  "in-close"  leading  to  excessive  rate  of  descent  "at  the  ramp1*. 
Of  the  environmental  factors,  night  conditions  and  deck  motion  were  most 
frequently  noted  In  the  accidents  reviewed.  Although  the  day/night  factor 
is  always  explicitly  Identified  In  accident  summaries,  other  environmental 
factors  may  have  existed  and  not  been  noted.  Also,  environmental  conditions 
are  seldom  cited  as  accident  cause  factors. 

Later  In  the  project,  a  more  comprehensive  analysis  of  carrier  landing 
accidents  was  conducted.  The  accidents  analyzed  occurred  In  the  fifteen 
year  period  between  1965  and  1980.  Results  are  presented  In  Appendix  G. 

The  primary  benefit  in  this  review  of  documents  and  accident  reports 
was  to  establish  an  Initial  picture  of  critical  LSO  skill  areas  and  waving 
conditions  as  guidance  for  further  data  gathering  and  analysis  In  the 
study.  Additionally,  the  sources  used  In  this  review  also  proved  beneficial 
In  the  Identification  of  key  LSO  learning  concepts. 
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SECTION  IV 
ISO  SURVEY 

A  training  survey  was  distributed  to  the  LSO  community  to  Identify 
critical  aspects  of  'waving"  which  are  most  Important  for  successful 
trainee  progression  to  a  Wing  LSO  designation.  Thirty-four  responses  were 
received.  For  sample  size  perspective,  there  are  approximately  ninety  LSO 
billets  requiring  at  least  a  Wing  Qualification.  Most  respondents  were  from 
this  population.  However,  a  few  were  recently  "retired"  LSOs.  A  copy  of 
the  survey  Including  a  summary  of  data  Is  provided  as  Appendix  B.  Results 
of  the  survey  are  described  and  discussed  below. 

RESPONDENTS 

The  respondents  were  asked  to  list  their  LSO  qualification  level, 
years  since  starting  LSO  training,  day  and  night  carrier  landings,  the 
number  of  cruises  completed  and  their  primary  aircraft  as  pilot.  Addition¬ 
ally,  they  were  to  mention  the  aircraft  which  they  were  qualified  to  wave. 

All  but  2  of  the  34  respondents  had  achieved  at  least  a  Wing  Qualifi¬ 
cation.  Eighteen  were  Staff  Qualification  level.  The  average  number  of 
years  experience  was  over  seven.  Only  four  had  less  than  five  years  of 
experience.  The  average  number  of  day  landings  was  261,  night  102.  The 
average  number  of  cruises  completed  was  2.9.  All  current  Navy  Inventory 
aircraft  were  listed  as  aircraft  which  the  respondents  were  qualified  to 
wave.  All  but  a  few  respondents  were  from  the  A-6,  A-7,  F-4  and  F-14  pilot 
communities.  The  experience,  expertise  and  cross-section  of  the  respondents 
are  considered  to  be  excellent  with  respect  to  the  credibility  of  informa¬ 
tion  obtained.  Comments  regarding  the  F/A-18  were  obtained  via  telephone 
conversations  with  Naval  Air  Test  Center  LSOs. 

SITUATION  VARIABLE  RATINGS 

The  respondents  were  asked  to  rate  25  night  situation  variables  as  to 
the  emphasis  required  In  training  LSOs.  Some  of  the  25  were  combinations  of 
two  or  more  Individual  variables.  The  mean  ratings  and  standard  deviations 
are  listed  In  Table  1.  All  variables  received  a  mean  rating  of  3.00  (mod¬ 
erate  priority)  or  above.  Sixteen  of  the  25  were  rated  above  3.50.  This 
outcome  was  probably  biased  In  the  selection  of  variables  to  be  rated  by 
the  LSOs,  since  the  purpose  of  the  questioning  was  to  have  LSOs  discrimi¬ 
nate  among  variables  generally  accepted  as  having  some  criticality  to 
waving  performance.  However,  the  primary  result  appears  to  be  that  of 
confirming  the  criticality  of  all  variables  rated. 

Seven  variables  were  rated  above  the  4.00  level  (high  priority). 
Among  the  four  highest  rated  variables,  "pitching  deck"  was  included  three 
times,  and  "MOVLAS"  and  "no  horizon"  were  each  Included  twice.  "'Itching 
deck  and  no  horizon  are  variables  having  major  Impact  on  t!\  pe  -eptual 
aspects  of  waving.  Use  of  the  MOVLAS  significantly  Increases  t'.e  LSO’s 
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TABLE  1.  RATINGS  OF  NIGHT  SITUATION  VARIABLES 


Variables 

Pitching  Deck,  No  Horizon 
MOVLAS,  Pitching  Deck 
MOVLAS,  Steady  Oeck 
Pitching  Deck,  MOVLAS,  No  Horizon 
Pilot  Unresponsive  or  Slow  to  Respond 
to  LSO 

Very  Unpredictable  Pilot 
"Trick  or  Treat"  Pass,  No  Tanker, 

No  Divert 

LSO  Talkdown 

Pitching  Deck,  Clear  Horizon 

Aircraft  Flight  Control  Emergency 

No  Horizon,  No  Plane  Guard 

Extremely  Poor  Start  Off  CCA 

Aircraft  Breaking  Out  of  WX  Inside  3/4  mile 

Barricade  Recovery 

Single  Engine  Approach 

Very  Inexperienced  Pilot 

No.  3  and  4  Wires  Missing 
Very  Unproficient  Pilot 
Extremely  High  or  Low  WOD 
No  Wing  Lights 

Higher  than  Normal  Approach  Speed 
Configuration 
NORDO 

Loss  of  LSO  Radio  After  Ball  Call 
No  External  AOA  Indexers 
Recovery  Crosswind 


Mean 

Standard 

Deviation 

4.32 

.77 

4.29 

.80 

4.20 

.41 

4.20 

1.20 

4.12 

.91 

4.06 

1.04 

4.03 

.94 

3.97 

.67 

3.94 

.78 

3.91 

.91 

3.89 

.86 

3.88 

.73 

3.88 

1.07 

3.74 

1.33 

3.67 

.92 

3.59 

.92 

3.41 

.82 

3.41 

.99 

3.38 

.85 

3.35 

.73 

3.26 

.89 

3.24 

.85 

3.15 

.82 

3.06 

.69 

3.06 

.95 

Scale:  1  *  No  training  emphasis  required 

2  ■  Low  priority 

3  *  Moderate  priority 

4  *  High  priority 

5  *  Extremely  high  priority 
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workload,  especially  when  compounded  by  the  presence  of  deck  motion.  The 
situation  of  "Pitching  Deck,  MOVLAS,  No  Horizon"  Is  generally  considered 
among  the  most  difficult  waving  situations  encountered  by  the  LSO.  However, 
Its  occurrence  Is  relatively  Infrequent,  probably  the  reason  why  it  did  not 
receive  the  highest  rating.  "Pitching  Deck,  No  Horizon"  Is  a  frequent 
occurrence  during  a  deployment.  Two  other  variables  which  rated  highly  were 
related  to  pilot  characteristics.  "Poor  pilot  responsiveness"  complicates 
the  LSO  decision  process  regarding  voice  call  selection  and  regarding 
whether  to  accept  an  approach  or  call  for  a  waveoff  In  close.  The  "un¬ 
predictable  pilot"  causes  similar  waving  difficulties.  The  final  variable 
above  a  4.00  rating  causes  a  high  pressure  waving  situation.  "Trick  or 
Treat"  without  a  tanker  or  a  divert  field  places  an  extreme  burden  on  the 
LSO  to  get  the  aircraft  aboard.  Failure  to  do  so  may  lead  to  a  barricade 
recovery  or  controlled  ejection.  Of  the  highest  rated  variables,  most  had 
relatively  low  standard  deviations.  Highest  variability  was  noted  In 
ratings  for  "Pitching  Deck,  MOVLAS,  No  Horizon."  This  was  probably  in¬ 
fluenced  by  Its  Infrequency  of  occurrence,  as  mentioned  earlier. 

The  responses  on  situation  variables  were  also  grouped  Into  logical 
categories  to  provide  additional  analytical  perspective.  The  categories  and 
their  respective  mean  ratings  and  standard  deviations  are  delineated  below: 


Environmental  Conditions 

3.87 

1.00 

Operational /Ship  Conditions 

3.84 

1.00 

Pilot  Characteristics 

3.81 

.95 

Aircraft  Malfunctions 

3.41 

.88 

"Pitching  Deck",  "No  Horizon"  and  "Aircraft  breaking  out  of  weather  Inside 
3/4  mile"  had  relatively  high  ratings  which  apparently  had  a  strong  In¬ 
fluence  on  the  Environmental  Conditions  category.  Strongest  Influences  In 
the  Operational /Ship  Conditions  category  Included  "MOVLAS",  "Trick  or  Treat 
Pass",  "LSO  Talkdown"  and  "Barricade  Recovery."  The  Pilot  Characteristics 
category  was  most  strongly  Influenced  by  high  ratings  for  "Unresponsive 
Pilot",  "Unpredictable  Pilot",  "Poor  start  off  CCA"  and  "Inexperienced 
Pilot."  Only  two  variables  In  the  Aircraft  Malfunctions  category  had 
ratings  above  3.50  ("Flight  Control  Emergency"  and  "Single  Engine 
Approach"),  thus  a  relatively  low  rating  for  this  category. 

VOICE  CALL  RATINGS 

The  respondents  were  asked  to  rate  56  standard  and  non-standard  LSO 
voice  calls  as  to  "their  criticality  to  successful  LSO  waving  performance 
under  "night  carrier  landing  conditions."  The  mean  ratings  and  standard 
deviations  for  the  calls  are  listed  In  Table  2.  LSOs  were  also  asked  to 
Indicate  whether  a  specific  call  should  never  be  used  (a  rating  of  0  on  the 
scale  provided). 
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TABLE  2.  VOICE  CALL  RATINGS  (Night  Assumed) 


Voice  Call 

Mean 

Waveoff 

4.74 

Power 

4.65 

Right  for  Lineup 

4.26 

Paddles  Contact 

3.88 

Attitude 

3.74 

You're  Low 

3.62 

Waveoff,  Foul  Deck 

3.61 

Roger  Ball 

3.58 

Left  for  Lineup 

3.43 

A  Little  Power 

3.30 

Don't  Go  Low 

3.03 

Don’t  Settle 

3.03 

A  Little  Attitude 

3.03 

You're  High 

3.00 

You're  a  Little  Low 

2.91 

You're  Slow 

2.91 

You're  Settling  (N) 

2.88 

Don't  Climb 

2.85 

You're  Low  and  Slow  (N) 

2.85 

A  Little  Power,  Right  for  Lineup  (N) 

2.82 

You're  Going  Low 

2.79 

Fly  the  Ball  (N) 

2.74 

Uncouple 

2.70 

Hold  What  You've  Got 

2.68 

Go  Manual 

2.65 

You're  a  Little  High 

2.62 

A  Little  Power,  Left  for  Lineup  (N) 

2.61 

Bolter 

2.59 

Deck  is  Moving  (N) 

2.59 

Deck  is  Moving,  Don't  Chase  the  Ball  (N) 

2.56 

Start  it  Back  to  the  Right  (N) 

2.53 

Start  it  Back  to  the  Left  (N) 

2.53 

Don't  Go  High 

2.50 

Start  it  Down  (N) 

’ 

2.47 

You're  Fast 

2.44 

You're  High,  Ease  it  Down  (N) 

2.42 

Standard 

Deviation 


.57 

.49 

.71 


1.14 

.83 

1.04 

1.39 

1.50 


1.50 

1.10 

1.00 

.90 

1.00 

.95 


.93 

1.19 

1.30 
1.05 
1.97 
1.09 

.98 

1.42 

1.40 

1.15 

1.12 

.89 

1.56 

.96 

1.60 

1.67 

1.26 

1.31 

1.02 


1.11 

.89 

1.12 
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TABLE  2.  VOICE  CALL  RATINGS  (Continued) 


Voice  Cell 


Mean 


You're  Lined  Up  Right 
Don't  Go  Through  It  (N) 

You're  Lined  Up  Left 
A  Little  Right  for  Lineup  (N) 
You’re  Going  High 
Cut 

Hold  Your  Attitude 
Catch  It  (N) 


2.38 

2.38 

2.35 

2.33 

2.26 

2.26 

2.18 

2.09 


A  Little  Left  for  Lineup  (N) 

You're  Drifting  Left 
You're  Drifting  Right 
Stop  It  In  the  Middle  (N) 

Check  Your  Lineup 
Ease  It  Down  (N) 

Fly  It  Down  (N) 

Work  It  Up  (N) 

Check  Your  Lineup.  Don't  Go  Low  (N) 
Hold  It  Up  (N) 


1.97 
1.94 
1.91 
1 .88 
1.85 
1.83 
1.58 
1.56 
1.53 
1.50 


A  Little  Power,  Don't  Climb  (N)  1.24 

Keep  Your  Nose  Up  0.76 


Scale:  0  »  Do  not  feel  It  should  ever  be  used 

1  ■  Definitely  not  critical 

2  ■  Possibly  critical 

3  »  Fairly  critical 

4  •  Definitely  critical 

5  ■  Extremely  critical 

Note:  (N)  ■  Non-standard  call 


Standard 

Deviation 


1.28 

1.16 

1.25 

1.31 

.90 

1.69 

1.19 

1.40 


1.40 
1.18 
1.14 
1.25 
1.09 
1.11 
1.32 
1.35 
1.35 
1  c4 


1.35 

.99 
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As  expected,  "Waveoff"  and  "Power"  were  among  the  highest  rated  calls. 
These  two  calls  and  "Right  for  Lineup"  had  mean  ratings  above  the 
"definitely  critical"  level  (4.00).  They  also  had  the  lowest  standard 
deviations  of  all  calls  rated. 

There  were  14  calls  rated  at  the  "fairly  critical"  level  (3.00)  or 
higher.  Eight  of  those  were  "Imperative"  calls  as  defined  by  LSO  NATOPS. 
Seven  calls  were  related  to  Impending  or  existing  low  glldeslope  devia¬ 
tions.  Only  one  call  was  related  to  a  high  deviation  and  only  two  were 
related  to  lineup  deviations.  Variability  among  responses  for  these  14 
calls  was  relatively  low.  The  only  exceptions  were  "Roger  Ball"  and  "Left 
for  Lineup". 

Standard  LSO  NATOPS  voice  calls  generally  rated  higher  than  non¬ 
standard  calls.  Only  three  non-standard  calls  (You're  settling",  "You’re 
low  and  slow"  and  "A  little  power,  right  for  lineup")  had  moderately  high 
ratings  between  2.8  and  2.9.  There  were  a  few  standard  calls  that  were 
rated  below  the  "possibly  critical"  level  (2.00):  "Check  your  lineup", 
"You're  drifting  right/left"  and  "Keep  your  nose  up."  There  were  19 
Instances  In  which  respondents  Indicated  that  the  lowest  rated  call,  "Keep 
your  nose  up",  should  never  be  used. 

Several  respondents  added  additional  voice  calls  to  the  listing.  There 
were  several  call  variations  regarding  deck  motion  which  were  rated  rela¬ 
tively  high.  There  were  also  a  few  suggestions  for  call  variations  Inclu¬ 
ding  ease"  or  "easy."  "DLC"  was  suggested  by  three  respondents.  Two 
additional  calls  were  considered  unique:  "Power,  please!"  and  "You're  going 
to  die  If  you  keep  this  up!"  They  are  Indicative  of  occasional  waving 
frustration  and  exhibit  LSO  creativity  In  catching  the  pilot's  attention  in 
critical  situations. 


DIFFICULT  WAVING  SITUATIONS 

Two  questions  In  the  survey  asked  for  descriptions  of  extremely 
difficult  waving  situations.  Question  3  asked  for  descriptions  "...of  the 
most^  dlff Icul t  waving  situations  you  have  experienced."  Question  6  asked 
for  "...the  most  difficult  night  waving  situations  you  can  imagine."  In 
response  to  the  first  question,  82  actual  situations  were  described. 
Approximately  60  situations  were  described  In  response  to  the  second 
question.  Of  the  82  actual  situations  described,  54  occurred  at  night. 
Night  conditions  were  specified  In  the  question  for  the  Imagined  situa¬ 
tions.  How  often  specific  situation  variables  were  mentioned  within  the 
actual  and  Imagined  situations  Is  listed  in  Table  3. 
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TABLE  3.  SITUATION  VARIABLES  (Day  and  Night  Situations) 


Variablt  Frequenc. 

No  Horizon  5$ 
Night  54 
Pitching  Deck  47 
Inexperienced  Pilot  30 
"Blue  Water"  OPS  (no  divert)  27 
Reduced  Visibility  26 
Unresponsive  Pilot  21 
MOVLAS  20 
Non«Optimum  WOD  19 
Boarding  Pressure  on  LSO  19 
Unproficient  Pilot  18 
Low  Pilot  Skill  Level  18 
Rain  18 
LSO  Talkdown  17 
Aircraft  Lighting  Problem  12 
Low  Fuel  State  11 
Aircraft  Engine  Problem  10 
Barricade  Recovery  8 
NORDO  6 
Poor  CCA  Control  6 
Pilot  Vertigo  6 
Aircraft  Flight  Control  Problem  5 
Aircraft  Visibility  Problem  4 
ACLS  Problem  4 
Arresting  Wires  Missing  3 
No  Lens  3 
ZIPLIP/EMCON  3 
Ship  Turn  -  2 
PRIFLY/CATCC  Coordination  Problem  2 
No  LSO  Radio  2 
Landing  Gear  Problem  1 
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"Mo  Horizon",  "Might"  and  "Pitching  Deck"  were  mentioned  much  more 
often  than  other  variables.  Overall,  variables  within  the  Environmental 
Conditions  category  were  mentioned  most  frequently,  as  Indicated  below: 

Environmental  Conditions  -  165 
Operational /Ship  Conditions  *  130 
Pilot  Factors  -  93 
Aircraft  Malfunctions  -  42 

Additional  environmental  conditions  frequently  noted  Included:  reduced 
visibility,  non-optimum  WOO  and  rain.  Operational  and  ship  conditions  most 
frequently  noted  Included:  "blue  water"  OPS,  MOVLAS,  boarding  pressure  and 
LSO  talk  down.  The  most  significant  pilot  factors  Included:  Inexperience, 
poor  responsiveness,  low  proficiency  and  low  skill  level.  Aircraft  mal¬ 
functions  were  Infrequently  noted.  Aircraft  types  which  were  most  fre¬ 
quently  noted  were  the  A-7  (22  times)  and  F-4  (21  times).  The  A-6  and  F-14 
were  each  mentioned  9  times. 

In  a  breakout  of  the  28  day  situations,  variables  related  to  the  pilot 
were  mentioned  much  more  frequently  than  others,  as  Indicated  below: 

Pilot  Factors  -  38 
Operational /Ship  Conditions  -  23 
Environmental  Conditions  -  16 
Aircraft  Malfunctions  -  6 

Pilot  Inexperience  (14  times),  low  skill  (10  times)  and  low  proficiency 
(eight  times)  were  most  frequently  noted  factors.  Boarding  pressure  on  the 
LSO  (eight  times)  was  the  most  frequently  noted  operational  condition.  No 
other  conditions  or  factors  were  mentioned  more  than  six  times.  The  F-4  was 
the  most  frequently  mentioned  aircraft  (7  times). 

The  actual  and  Imagined  situations  were  also  reviewed  to  Identify 
frequently  mentioned  combinations  of  variables.  "Pitching  Deck"  and  "No 
Horizon"  were  most  frequently  noted.  Frequently  noted  combinations  are 
listed  below  (all  assume  the  night  environment): 

Pitching  Deck,  No  Horizon  -  33 
MOVLAS,  No  Horizon  -  19 
Pitching  Deck,  No  Horizon,  MOVLAS  -  18 
Pitching  Deck,  MOVLAS  -  18 
Aircraft  Malfunction,  No  Horizon  -  14 
Pitching  Deck,  "blue  water"  Ops  -  12 

In  general,  the  results  from  analyzing  difficult  waving  situations 
appear  to  correlate  to  the  ratings  of  night  situation  variables  discussed 
earlier. 
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CRITICAL  APPROACH  PROFILES 


Respondents  were  asked  to  describe  typical  approach  profiles  which  can 
lead  to  unsuccessful  results  (l.e.  ramp  strike,  hard  landing,  off-center 
engagement,  bolter  and  In-flight  engagement).  The  approach  profile  trends 
which  emerged  are  described  below  In  conjunction  with  their  landing 
outcomes.  Table  4  presents  a  summary  of  the  profiles  In  LSO  shorthand 
(shorthand  explanations  are  provided  In  LSO  NATOPS). 


V  RAMP  STRIKE/HARD  LANDING.  There  were  several  profile  trends  leading  to 

potential  ramp  strike/hard  landing  outcomes.  Four  general  trends  were 
U  prominent.  The  first  trend  Involves  an  over-reaction  to  an  existing  or 

Impending  high  deviation  In  close.  Profiles  exhibiting  this  trend  Include: 


"low  start  to  high  In  the  middle  or  In  close,  come  down  at  the 
ramp" 

"high  start  to  In  close,  come  down  at  the  ramp" 

"over-control  a  climb  In  close,  come  down  at  the  ramp" 

The  second  trend  Involves  an  underpowered  approach  In  which  the  air¬ 
craft  settles  at  the  ramp  as  the  result  of  a  deceleration  or  passing 
through  the  burble.  The  third  trend  Involves  a  settle  at  the  ramp  due  to  an 
under-powered  condition  caused  by  a  late  lineup  correction.  The  final  trend 
Involves  a  premature  power  reduction  and/or  nose  down  adjustment,  while 
correcting  for  a  low  deviation  In  close. 

OFF-CENTER  ENGAGEMENT.  Three  general  profile  trends  leading  to  off-center 
engagement  outcomes  emerged.  The  first  trend  Involves  a  lineup  deviation 
(right  or  left)  early  In  the  approach  followed  by  a  gradual  drift  to  an 
opposite  off-lineup  deviation  at  the  ramp.  The  second  trend  Involves  an 
over-reaction  to  an  off-lineup  deviation  In  close  leading  to  an  unaccept¬ 
able  lineup  drift  at  the  ramp.  The  third  profile  trend  Is  a  drift  right  or 
left  In  close  or  at  the  ramp,  probably  under  the  Influence  of  a  recovery 
cross-wind  and/or  a  breakdown  In  the  pilot's  lineup  scan. 

BOLTER.  Most  bolters  result  from  an  over-reaction  to  a  low  deviation  or  a 
settle  In  close,  or  to  an  LSO  call  for  power  or  attitude.  Another  bolter 
trend  results  from  an  over-powered  condition  caused  by  late  lineup 
corrections. 

IN-FLIGHT  ENGAGEMENT.  In-flight  engagement  typically  occurs  when  the  pilot 
Increases  nose  attitude  excessively  In  response  to  an  excessive  sink  rate 
In  close  or  at  the  ramp,  or  In  response  to  an  LSO  call  for  power  or 
attitude.  It  can  also  occur  In  response  to  a  waveoff. 

^  U.S.  Navy,  Office  of  the  Chief  of  Naval  Operations.  The  Naval  Air 
Training  and  Operating  Procedures  Standardization  (NATOPS)  Program  Manual. 
Landng  Signal  Officer  (LSO),  Department  of  the  Navy,  1975. 
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TABLE  4.  CRITICAL  APPROACH  PROFILES 


Ramp  Strike/Hard  Landing: 


s 

I 


LOX  HIM-IC  CDAR 
HX-1C  CDAR 
OC  CIC/HIC  CDAR 
NEPAU  SAR 
SAR  on  LLU 


EG/DN  correcting  for  LOIC 


•w’ 


Off-Center  Engagement: 

LURX/IM  R-LAW 
LULX/IM  L-RAU 
OCLULIC  L-RAR 
OCLURIC  R-LAR 
ORRIC/AR 
DRLIC/AR 


Bolter: 

OCLOIC/SIC  ^7 
OCCO 

TMP  on  LLUIC  ^ 


In-flight  Engagement: 

COIC-AR  PNU  0C0 
CDIC-AR  PW  on  WO 
OCCDAR  ?WT 
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AIRCRAFT  CHARACTERISTICS/LIHITATIOMS 

The  LSOs  were  also  asked  to  describe  aircraft  characteristics,  perfor¬ 
mance  limitations  and  malfunctions  of  concern  to  the  ISO  when  waving  an 

approach.  The  Information  gathered  Is  summarized  below. 

A-6:  Excellent  power  and  waveoff  response,  but  easily  over  controlled. 

Tendency  to  settle  on  late  lineup  corrections. 

Tendency  for  hook- skip  bolters  on  nose  down  landings. 

KA6  (tanker)  Is  a  little  underpowered. 

Pilot  visibility  deficiencies  result  In  frequent  lineup  control 
difficulties. 

Single  engine  Is  only  a  problem  under  conditions  of  high  gross 
weight,  high  winds,  high  temperature. 

With  a  single  generator  failure  all  external  lights  are  out 
except  AOA  Indicator. 

EA-6B:  Excellent  power  and  waveoff  response. 

Long  fuselage  and  sensitive  nose,  therefore  high  In-flight 
engagement  potential. 

Tendency  for  hook-skip  bolters  on  nose  down  landings. 

Frequently  described  as  similar  to  basic  A-6. 

Tendency  for  decel  due  to  sensitive  nose. 

A-7:  Slow  engine  response  when  back  on  power. 

HIM  frequently  leads  to  SIC-AR;  LOX-IM  frequently  leads  to 
bol ter. 

LOB  pass  requires  nose  finesse,  to  avoid  bolter  or  ramp  strike/ 
hard  landing. 

AOA  system  and  external  AOA  Indicator  lights  fall  frequently. 

E-2:  Excellent  power  response. 

Lineup  control  difficult;  also  very  critical  due  to  long  wing¬ 
span. 

Long  fuselage,  therefore  high  In-flight  engagement  potential. 

Glldeslope  control  very  sensitive  to  nose  movement. 

Fuselage  alignment  lights  (when  visible)  Indicate  need  for  right 
rudder. 

Tendency  for  hook  skip  bolter  on  nose  down  landing. 

On  single  engine  approach,  lineup  control  is  difficult;, also 
decel  must  be  avoided. 

Lineup  Is  extremely  critical  (♦  2-1/2  feet)  on  barricade 
recovery. 

On  no-flap  approach,  very  cocked  up  and  hook-to-ramp  clearance  Is 
reduced. 

F-4:  Excellent  power  and  waveoff  response;  also  easy  to  overcontrol 

glldeslope  (up  and  down). 

Faster  approach  speed  than  others;  high  WOD  requirements  due  to 
arresting  gear  engaging  limits. 
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Fuel  critical;  frequently  few  looks  before  tanking  or  divert. 

Must  beware  of  HIC;  can  lead  to  hard  landing  due  to  ease  of 
glldeslope  correction  with  power  reduction. 

Loss  of  Boundary  Layer  Control  (BLC)  means  very  high  approach  speed. 
Single  engine  approach  done  at  half  flaps  and  speed  Is  signifi¬ 
cantly  Increased;  power  response  significantly  degraded. 

F-1A:  Slow  engine  response  after  back  on  power. 

fends  to  SIC  when  "gliding"  through  burble. 

Long  fuselage,  therefore  In-flight  engagement  potential. 

Hook-skip  bolter  potential  on  nose  down  landings  and  for  late 
lineup  corrections  at  ramp. 

Lineup  critical  due  to  long  wingspan. 

Without  DLC  engaged,  aircraft  Is  back  on  power. 

F/A-18:  Excellent  power  and  waveoff  response. 

Flat  attitude  when  on  AOA. 

If  back  on  power  and  cocked  up,  SIC-AR  Is  probable. 

Easy  to  overrotate  on  waveoff;  In-flight  engagement  potential. 

Nose  adjustments  must  be  coordinated  with  power  changes  to  get 
glldeslope  correction  results. 

S-3:  Slow  engine  response  when  back  on  power. 

Tendency  to  "glide"  during  approach. 

DLC  Is  good  for  correcting  high  deviation  and  avoiding  an 
undesired  power  reduction. 

Without  DLC  system,  nose  pitch  Is  sensitive  to  power  changes. 
Difficulties  with  burble.under  high  WOD  conditions. 


SUMMARY 

The  results  of  this  survey  provided  excellent  Insight  to  LSO  percep¬ 
tions  of  what  Is  difficult  and  critical  within  the  job  of  the  LSO.  The 
survey  also  proved  to  be  an  excellent  source  of  "lessons  learned"  Inputs  to 
the  Identification  of  key  LSO  learning  concepts.  However,  the  perceptions 
by  LSOs  of  what  Is  critical  versus  the  conditions  which  have  actually  led 
to  accidents  may  or  may  not  agree.  The  next  section  addresses  accident 
data. 
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SECTION  V 

COST  SAVINGS  ESTIMATION 


INTRODUCTION  AND  SUMMARY 

One  of  the  study  objectives  for  this  contract  was  to  Identify  the 
potential  cost  savings  which  could  accrue  from  Implementation  of  an  auto¬ 
mated  ISO  training  system  Into  the  LSO  training  program.  Through  analysis 
of  recent  carrier  landing  accidents  It  was  estimated  that  savings  of  more 
than  $21  million  are  probable  over  a  ten-year  period.  The  analysis  effort 
leading  to  this  estimate  Is  Introduced  below  and  described  later  In  detail. 

The  general  characteristics  and  capabilities  of  an  automated  LSO 
training  system  have  emerged  from  earlier  NAVTRAEQUIPCEN  studies.  An 
Important  aspect  of  the  Instructional  concept  for  the  system  is  emphasis  on 
critical  waving  situations.  This  Is  analogous  to  the  use  of  flight  simula¬ 
tion  In  pilot  training  for  emphasis  on  emergency  procedures  and  situa¬ 
tions.  Critical  waving  situations  can  be  defined  as  Instances  where 
deficiencies  in  waving  skills  can  lead  to  unsafe  landing  results,  or 
failure  to  achieve  required  boarding  efficiencies.  The  most  obvious  con¬ 
cern  Is  directed  toward  preventing  aircraft  damage  and  personnel  Injuries 
and  losses  In  the  carrier  landing  process. 

Carrier  landing  mishaps  are  occurrences  which  are  quantifiable  In 
terms  of  dollars  lost  due  to  aircraft  damage  (or  loss).  Sometimes  person¬ 
nel  losses  are  also  sta-ted  In  terms  of  dollars.  In  this  study,  personnel 
losses  were  not  addressed.  Thus  the  analysis  focused  on  aircraft  damages 
and  losses  as  the  basis  for  estimating  potential  cost  savings.  However, 
other  potential  benefits  were  looked  at  from  a  qualitative  standpoint  and 
are  addressed  later  In  this  report. 

At  this  point  some  clarification  about  the  role  of  the  LSO  in  carrier 
landing  accidents  may  be  appropriate  to  some  readers.  Historically,  the  LSO 
and  pilot  have  been  the  most  frequently  noted  causal  factors  In  carrier 
landing  accidents.  Over  the  past  15  years,  the  LSO  has  been  cited  as  a 
causal  factor  In  about  20  percent  of  all  carrier  landing  accidents.  Over 
the  same  period  the  pilot  has  been  cited  about  62  percent  of  the  time.  It 
should  be  noted  here  that  in  a  single  accident  both  the  pilot  and  the  LSO 
can  be  cited  as  causal  factors.  The  determination  of  causal  factors  Is 
Initially  established  by  an  accident  Investigation  board  whose  findings  are 
reviewed  by  several  command  levels  and  the  Naval  Safety  Center  prior  to  the 
final  establishment  of  official  cause  factors. 

Pilot  performance  during  landing  has  obvious  Implications  to  a  carrier 
landing  accident.  An- accident  can  result  from  poor  flying  performance,  thus 
the  basis  for  the  pilot  being  cited  a  causal  factor  In  an  accident.  The 
Implications  of  LSO  performance  are  not  quite  so  obvious.  His  job  Is  to 
assist  the  pilot  during  the  landing  process  with  voice  calls  and  light 
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signals  as  supplemental  cueing.  This  task  Is  most  Important  at  night  when 
the  pilot  must  perform  his  task  with  reduced  visual  cues,  or  anytime  there 
are  unusual  operating  conditions,  such  as  pitching  deck,  which  may  Increase 
the  difficulty  of  the  pilot's  tasking.  However,  the  most  critical  role 
played  by  the  LSO  during  landing  Is  that  of  judging  whether  the  aircraft 
can  continue  the  approach  to  a  safe  landing.  This  Is  where  the  LSO  is 
usually  "on  the  hook"  as  a  potential  accident  causal  factor.  No  matter  how 
poor  the  pilot's  performance.  If  the  LSO  allows  an  unsatisfactory  approach 
to  continue  to  an  accident,  he  too  will  usually  be  cited  as  a  causal 
factor.  Typically  this  case  would  be  stated  In  an  accident  report  as  "the 
LSO  failed  to  give  a  .timely  waveoff." 

One  of  the  primary  goals  of  LSO  training  Is  to  equip  the  LSO  with  the 
perceptual  and  decision  skills  needed  to  prevent  carrier  landing  accidents. 
Research  has  Identified  that  there  Is  room  for  improvement  In  the  LSO 
training  program.43,44  It  has  also  Identified  that  simulation  of  the 
carrier  landing  environment  and  effective  utilization  of  this  medium  has 
significant  potential  to  make  a  positive  Impact  on  the  LSO  training  pro¬ 
gram. 44, 45 

The  study  described  In  this  part  of  the  report  attempts  to  quantify 
the  value  of  such  an  Improvement  In  LSO  training  by  analyzing  LSO  perfor¬ 
mance  In  carrier  landing  accidents  and  relating  LSO  performance  deficien¬ 
cies  to  anticipated  LSO  training  system  capabilities. 

One  could  make  a  theoretical  case  for  the  possibility  that  perfect  LSO 
performance  could  prevent  all  accidents  In  which  the  LSO  was  cited  as  a 
causal  factor.  However,  It  will  never  be  realistic  to  assume  perfect  LSO 

ferformance.  Since  there  are  other  human  factors  In  the  landing  process 
pilot,  shipboard  personnel),  as  well  as  operational  and  environmental 
factors,  total  accident  prevention  Is  also  an  unrealistic  “xpectation. 
Therefore  expert  judgments  were  used  to  conservatively  assess  the  extent  to 
which  these  factors  could  be  mitigated  through  Improved  LSO  training. 


Borden,  G.J.,  The  Landing  Signal  Officer:  A  Problem  Analysis,  Vols. 
I,  II.  Technical  Report  785-1,  Goleta,  Calif.:  Human  Factors  Research, 
Inc.,  Hay  1969. 

**  Hooks,  J.T.,  Butler,  E.A.,  Gullen,  R.A.  and  Petersen,  R.J.,  Design 
Study  for  an  Auto-Adaptive  Landing  Signal  Officer  (LSO)  Training  System, 
YechnicalTeport,  NAVTRAEQUIPCEN  77-C-0109-1,  Naval  Training  Equipment 
Center,  1978. 

45 

Hooks,  J.  Thel ,  HcCauley,  Michael  E.,  Training  Characteristics  of 
the  LSO  Reverse  Display,  Technical  Report,  NAvTRAEQUi HCtN  /y-L-uiui-'Z7 
RavalTraining  Equipment  Center,  1980. 
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Experienced  LSOs  were  used  in  this  study  to  judge  two  aspects  of 
carrier  landing  accidents  which  occurred  over  the  past  ten  years.  A  sample 
of  24  accidents  was  used  In  the  study.  The  first  judgment  was  whether  the 
ISO  could  have  prevented  the  accident.  The  second  judgment  was  whether 
Improved  LSO  training  could  have  had  a  positive  influence  on  the  quality  of 
his  performance.  The  judgments  were  obtained  in  group  LSO  sessions  and  were 
In  probability  terms.  For  example,  after  reviewing  the  description  of  an 
accident,  the  group  of  LSOs  may  have  judged  that  there  was  a  60  percent 
probability  that  the  LSO  could  have  prevented  the  accident,  and  that  there 
was  a  50  percent  probability  that  improved  LSO  training  could  have  posi¬ 
tively  influenced  his  performance.  Subsequent  to  obtaining  LSO  judgments, 
the  primary  author  who  is  a  senior  training  systems  analyst  with  experi¬ 
ence  In  LSO  training  system  research,  judged  the  likelihood  that  an  LSO 
training  system  could  provide  Improved  training  for  each  accident  situa¬ 
tion. 


This  series  of  three  probability  terms  was  then  multiplied  with 
costing  values  associated  with  each  accident  to  estimate  potential  cost 
savings.  This  cost  savings  estimation  process  can  be  expressed: 


Ssave  *  PP  x  PT  x  PS  x  Sloss 


where:  Pp 

n 


probability  of  LSO  preventing  accident 
probability  training  would  have  helped  LSO 

probability  that  LSO  training  system  can 

be  developed  with  required  capability 


The  results  Indicate  that  an  LSO  training  system  has  significant  potential 
for  saving  dollars  by  helping  LSOs  reduce  carrier  landing  accidents.  Sub¬ 
sequent  sections  of  this  part  of  the  report  describe  the  design  of  the 
study,  data  collection  and  analysis,  and  Interpretation  of  the  results. 
Appendix  C  of  the  report  presents  the  materials  used  In  the  study  and  raw 
data  collected. 


STUDY  DESIGN 

The  study  plan  originated  from  the  notion  that  If  LSO  training  Is 
Improved,  there  should  be  some  improvement  In  carrier  landing  safety. 
Improvements  In  carrier  landing  safety  are  typically  reflected  In  reduc¬ 
tions  of  the  carrier  landing  accident  rate.  However,  the  cost  6f  carrier 
landing  accidents  was  considered  a  more  sensitive  Indicator  of  this 
Improvement  since  they  can  vary  by  aircraft  type  and  In  the  level  of  damage 
Incurred.  For  example,  the  official  cost  assigned  to  loss  of  an  F-14A  Is 
much  higher  than  that  for  an  A-7E.  Additionally,  the  damage  may  be  classi¬ 
fied  as  aircraft  destroyed  or  substantial  damage.  An  early  step  In  this 
study  was  to  obtain  official  costing  figures  for  the  two  levels  of  damage 
by  aircraft  type.  The  figures  obtained  were  average  costs  for  FY80  as 
established  by  the  Naval  Air  Systems  Command. 
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There  were  other  Infuences  upon  the  design  of  this  study.  Of  major 
Importance  was  selection  of  an  approach  for  estimating  the  potential  Impact 
of  Improved  training  on  LSO  job  performance. A  general  estimate  of  Improved 
LSO  performance  from  experienced  LSOs  was  considered  an  acceptable  and 
expeditious  approach.  This  could  then  have  been  used  with  accident  costs 
to  estimate  cost  savings  accruing  from  Improved  LSO  training.  However,  It 
was  felt  that  the  experienced  LSO  estimates  would  be  more  valid  If  they 
were  based  on  specific  accident  occurrences.  The  next  consideration  was  how 
to  look  at  past  accident  occurrences  and  project  the  estimated  cost  savings 
to  future  carrier  landing  operations.  To  do  this  with  a  reasonable  confi¬ 
dence  level,  the  estimates  should  cover  a  representative  historical  period 
of  sufficient  duration  to  account  for  influences  on  carrier  landing  safety, 
such  as  operations  tempo.  The  recent  decade  was  considered  promising  in 
that  it  incuded  variations  in  operations  tempo  (combat  and  peacetime  opera¬ 
tions),  transition  of  new  aircraft  Into  the  fleet  (F-14,  S-3),  and  a  wide 
variation  In  carrier  landing  accident  rate  (high  early  In  period  and  low 
late  In  period). 

A  major  component  required  for  the  study  was  a  set  of  carrier  landing 
accident  descriptions.  Computer  printout  summaries  of  158  carrier  landing 
accidents  were  available  and  covered  the  period  from  July  1970  throuqh 
Oecember  1979.  The  next  step  was  to  determine  a  meaningful  and  reasonable 
sample  of  accidents  to  be  used.  The  first  criteria  that  was  used  was  to 
select  only  those  accidents  In  which  the  LSO  was  officially  cited  as  a 
causal  factor.  There  were  51  which  met  this  criteria.  They  are  listed  In 
Table  5.  Next,  the  sample  was  reduced  on  the  basis  of  other  factors. 
Accidents  involving  older  aircraft  (such  as  RA-5C,  F-8,  A-3,  E-l  and  fleet 
A -4)  were  eliminated  to  Insure  LSO  experience  with  the  aircraft  used  In  the 
study.  Of  the  regaining  accidents,  several  more  were  eliminated  due  to  th. 
pauclty  of  descriptive  information  available  In  the  computer  summary.  This 
left  a  sample  of  24  accidents  to  be  used  In  the  study.  They  are  noted  by 
asterisk  In  Table  5.  The  aircraft  represented  In  the  sample  Include  A-7, 
F-4 ,  F-14,  A-6  and  TA-4. 

Selection  of  a  method  for  obtaining  LSO  judgments  was  another  impor¬ 
tant  aspect  of  study  design.  The  survey  question*  *ire  method  was  one  which 
was  considered  and  rejected  for  setaral  reason.  First,  there  was  too  much 
uncertainty  regarding  whether  responses  would  be  timely  enough  within  the 
contract  period.  Secondly,  there  was  concern  for  ./h  ther  there  would  be  an 
adequate  response  rate  since  the  survey  approach  would  require  a  few  hours 
of  each  respondent’s  time.  The  final  reason  was  one  of  practicality  rela¬ 
tive  to  time  required  for  Initial  data  reduction.  Many  Individual  responses 
would  require  the  handling  of  a  large  amount  of  data,  demanding  more  time 
and  resources  than  were  avalable  for  the  study.  Thus,  the  determination  was 
made  to  collect  the  judgments  In  one  or  more  group  LSO  accident  review 
sessions.  Llaslon  with  the  COMNAYAIRPAC  and  COMNAVAIRLANT  LSOs  Indicated 
the  feasibility  of  scheduling  two  group  sessions  of  highly  experienced 
LSOs,  one  on  each  coast.’ 
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TABLE  5.  ACCIDENTS  IN  WHICH  LSO  CITED  AS  CAUSE  FACTOR 
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The  details  of  the  data  gathering  session  were  then  planned 
and  evaluated.  For  each  accident,  relevant  descriptive  information 
was  extracted  from  the  computer  summary  and  prepared  in  the  form 
of  overhead  projector  viewgraphs.  The  information  for  each  acci¬ 
dent  included:  1)  aircraft  type,  2)  day  or  night  conditions, 

3)  carrier,  4)  narrative,  verLatum  from  computer  summary,  and  5) 
pilot  experience  i nf orma t i on  ,  when  available.  Instructions  to 
respondents  provided  some  background  on  the  purpose  of  the  study, 
the  sample  of  accidents  to  be  reviewed,  session  procedures  and 
guidelines  for  LSO  judgments.  Formats  for  data  gathering  included 
rating  scales,  a  checklist  of  training  topics  to  use  when  identify¬ 
ing  important  training  requirements  for  each  accident  and  an  exper¬ 
ience  questionnaire  for  each  LSO  participant.  Appendix  C  includes 
copies  of  the  viewgraph  materials  designed  for  data  gathering 
dur.ng  the  sessions.  Review  ofAppendix  C  will  provide  amplifica¬ 
tion  of  the  descriptions  provided  above.  Materials  and  procedures 
were  then  used  in  a  trial  session  with  an  experienced  LSO  to 
evaluate  adequacy  of  the  data  gathering  method  and  materials,  and 
to  determine  time  requirements  for  the  session.  This  resulted  in 
a  few  minor  refinements  to  the  process  and  materials. 

In  conducting  the  data  gathering  session,  a  general  procedure 
was  followed.  The  session  was  conducted  by  the  senior  study 
analyst.  The  session  was  initiated  by  the  presentation  of  back¬ 
ground  information,  session  procedures  and  guidelines  for  LSO 
judgments.  The  first  two  accidents  presented  were  treated  as 
examples,  to  allow  the  participants  to  warm  up  to  the  data  gather¬ 
ing  task.  As  each  accident  was  presented,  the  participants  were 
given  a  few  minutes  to  read  it,  then  the  session  leader  clarified 
or  highlighted  relevant  items  in  the  narrative.  LSOs  who  had 
first  hand  information  or  experience  with  the  accident  were  then 
given  an  opportunity  to  present  amplifying  commentary.  Following 
this,  the  group  was  asked  to  judge  the  "possibility  that  the  LSO 
(controlling  or  backup)  could  have  prevented  the  mishap."  Follow¬ 
ing  an  initial  response,  some  discussion  usually  occurred  as  the 
group  was  asked  to  judge  the  "possibility  that  improved  training 
and/or  additional  experience  could  have  helped  the  LSO(s)  to 
better  handle  the  situation."  Again,  there  war  usually  group 
interaction  prior  to  establishing  a  consensus  judgment.  The  final 
step  for  each  accident  reviewed  was  for  the  group  to  fdentify 
"aspects  of  this  mishap  situation  which  would  be  particularly 
important  in  preparing  an  LSO  for  this  or  a  similar  situation." 
There  were  no  cases  during  data  gathering  in  which  a  consensus 
was  not  attained  for  Pprevent  or  Ptrain.  Most  of  the  time,  the 
judgments  which  were  obtained  were  for  a  20  percent  range  on  the 
scale  (i.e.,  40-60  percent,  80-100  percent).  In  several  cases,  a 
specific  probability  value  was  agreed  upon  (i.e.,  80  percent, 

100  percent).  Responses  during  the  session  were  recorded  on  paper 
and  on  tape.  Tape  recording  of  the  session  was  done  because  it 
had  been  anticipated  that  there  would  be  discussions  and  commentary 
relevant  to  other  aspects  of  the  study,  such  as  the  identification 
of  additional  key  concepts  and  critical  waving  situations  and 
variables. 
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OATA  COLLECTED 

The  first  data  gathering  session  was  held  at  NAS  Miramar,  California, 
with  participation  by  seven  experienced  LSOs,  Including  the  COMNAYAIRPAC 
LSO.  The  second  session  was  held  at  NAS  Cecil  Field,  Florida.  Of  the  13 
experienced  LSOs  Involved  In  this  session,  one  was  the  COMNAVAIRLANT  LSO  and 
another  was  the  LSO  Training  Model  Manager.  This  sample  of  20  from  the  LSO 
community  had  Impressive  credentials.  Eight  of  the  LSOs  had  attained  a 
Staff  LSO  qualification  level.  The  remaining  LSOs  all  had  either  a  Wing  or 
Training  qualification,  or  both.  There  was  also  a  good  mix  of  fleet  air¬ 
craft  communities  represented  (Eight  from  A-7,  four  from  F-14,  three  from 
A-6,  two  from  F-4). 

The  data  collected  are  presented  in  Table  6.  The  accident  sample  of  24 
was  from  the  period  ov  July  1970  through  December  1979.  Most  accidents  (19) 
occurred  at  night.  There  were  two  levels  of  damage  specified:  aircraft 
destroyed  (A)  and  substantial  damage  (C).  The  total  loss  for  the  accidents 
was  $57,356,000  based  on  official  Navy  figures  for  FY80.  Most  of  the 
accidents  (18)  involved  A-7  and  F-4  aircraft. 

The  LSO  judgments  presented  in  the  table  are  based  on  a  weighted 
average  of  the  judgments  obtained  at  the  two  data  collection  sessions. 
Table  7  provides  an  accounting  of  the  frequency  with  which  an  LSO 
training  requirement  topic  was  noted  during  the  data  collection  sessions. 
Raw  data  from  the  sessions  are  presented  in  Appendix  C. 

DATA  ANALYSIS  AND  RESULTS 

Given  the  data  collected,  the  major  analytical  thrust  was  to  relate 
anticipated  LSO  training  system  capabilities  to  specific  improvements  In 
LSO  training.  The  approach  taken  was  to  establish  a  probability  (P$  )  that 
an  LSO  training  system  could  be  developed  to  provide  effective  LSO  training 
for  each  accident  situation. 

To  produce  this  judgment  there  were  two  major  considerations.  The 
first  was  the  complexity  of  the  learning  required  for  a  partlclar  accident 
situation.  The  estimated  Impact  of  this  factor  was  that  for  higher 
complexity  there  would  be  higher  risk  Involved  in  the  attainment  of  an 
effective  and  appropriate  Improvement  In  LSO  training  with  an  automated  LSO 
training  system.  Thus  high  complexity  would  reduce  P5  .  The  second  con¬ 
sideration  was  one  of  technological  risk  relative  to  the  attainment  of 
required  training  system  capability.  The  estimated  impact  of  this  factor 
was  that  for  higher  technological  risk,  Ps  would  be  reduced. 

The  training  requirements  specified  by  LSOs  for  each  accident  situa¬ 
tion  were  analyzed  to  estimate  the  complexity  of  the  training  process 
required  to  support  learning.  If  the  training  requirements  suggested  simple 
relationships  between  cues  and  appropriate  LSO  actions,  the  learning  com¬ 
plexity  factor  was  considered  minimal.  An  example  of  this  would  be  a  case 
In  which  the  pilot  flew  an  extremely  erratic  approach  giving  the  LSO  no 


39 


NAVTRAEQUIPCEN  80-C-0063-2 


TABLE  6.  DATA  COLLECTED  (In  order  presented) 
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TABLE  7.  LSO  TRAINING  REQUIREMENTS  IDENTIFIED 

Requl rement  No.  of  Accidents 

Waveoff  decision  20 

Use  of  timely  and  correct  LSO  calls/signals  16 

LSO  platform  team  Interaction/coordination  16 

Recognizing  approach  deviations  14 

LSO  knowledge  (procedures,  rules/limits,  aircraft,  etc.)  14 

Poor  pilot  responsiveness  to  LSO  12 

Low  pilot  experience  level  11 

Boarding  pressure  7 

Aircraft  malfunctions  7 

“Classic"  approach  trends  6 

Recovery  coordination  (CATTC/PRIFLY/LSO)  6 

Non-optimum  UOD  5 

Deck  motion  4 

Platform  location  3 

Knowledge  of  low  pilot  skill  level  3 

MOVLAS  2 

Barricade  recovery  2 

Deck  status  (clear/foul)  2 

Weather/rain/poor  visibility 
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confidence  that  It  could  lead  to  a  safe  landing.  The  appropriate  ISO  action 
based  on  these  rather  obvious  cues  would  be  a  waveoff.  However,  at  the 
other  end  of  the  learning  complexity  spectrum  would  be  a  case  where  the 
relationships  between  cues  and  LSO  actions  are  not  so  obvious.  An  example 
of  this  would  be  a  case  In  which  there  were  non-optimum  operating  condi¬ 
tions  (deck  motion,  weather,  wires  missing,  etc.)  and  subtle  Indications  of 
less  than  acceptable  pilot  performance  (sluggish  response  to  LSO  calls, 
tendency  to  fly  slightly  low  or  high,  slightly  unsettled  lineup  control., 
etc.).  For  this  situation,  the  LSO  must  be  taught  to  integrate  many  factors 
and  complex  relationships  Into  the  waving  decision  process 


The  technological  risk  aspect  of  this  judgment  was  Influenced  by  the 
training  requirements  and  the  status  of  technology  to  provide  simulation  and 
Instructional  support.  The  training  requirements  suggested  specific 
simulation  and  Instructional  support  capability  requirements.  These  capabi¬ 
lity  requirements  were  then  analyzed  by  looking  at  existing  evidence  of 
feasibility  and  projections  of  near-term  training  systems  technology. 


Evidence  of  technological  feasibility  exists  in  utilization  of  the  LSO 
Reverse  Display  (LSORD),  an  LSO  training  station  attached  to  the  A-7E  Night 
Carrier  Landing  Trainer  (NCLT).  This  device  Is  being  used  for  limited 
support  of  LSO  training  at  NAS  Cecil  Field  under  the  cognizance  of  the  LSO 
Training  Model  Manager.  It  has  proven  capabilities  for  some  simulation 
aspects  of  the  waving  environment.  It  also  has  proven  capabilities  for 
some  Instructional  support.  The  results  of  an  evaluation  of  the  LSORD  were 
reported  by  Hooks  and  McCauley  (1980).^  Their  report  provides  elaboration  on 
the  capabilities  and  limitations  of  the  LSORD  and  Its  effectiveness  for 
supporting  LSO  training.  In  cases  where  the  LSORD  has  demonstrated  the 
capability  to  effectively  support  training  for  an  accident  situation,  a  low 
risk  factor  was  assigned.  In  cases  where  there  were  only  projections  of 
technological  feasibility  based  on  research  or  other  training  applications, 
a  higher  risk  factor  was  assigned. 


An  Important  assumption  was  Included  In  the  determination  of  Pc  jt 
was  assumed  that  the  LSO  training  system  provided  training  support  to  *al T 
LSO  trainees.  One  of  the  major  limitations  of  the  LSO  Reverse  Display 
technology  Is  that  It  Is  not  available  to  all  LSO  trainees  because  It  Is 
only  located  at  two  sites,  NAS  Cecil  Field  and  NAS  Lemoore.  There  Is 
additional  limitation  In  Its  accessibility  since  It  Is  linked  to  the  A-7E 
NCLT  which  Is  used  extensively  for  pilot  training  and  which  has  utilization 
priority.  For  an  LSO  training  system  to  be  effective.  It  must  be  located  at 
a  sufficient  number  of  sites  to  provide  priority  access  for  all  partici¬ 
pants  In  the  LSO  training  program. 


— ^ - 

Hooks,  J.  Thel ,  McCauley,  Michael  E.,  Training  Characteristics  of  the 
LSO  Reverse  Display,  Technical  Report,  NAVTRAEQUIPCEN  79-C-0101-2,  Naval 
Training  Equipment  Center,  1980. 
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In  summary, 
represented  by: 

the  analytical  process  described  above  can  be  conceptually 

ps  - 

f  (PI. 

PC) 

where: 

pS  * 

probability  that  LSO  training  system  can 
be  developed  with  requlrea  capability 

pI  - 

probability  of  Instructional  effectiveness 

and. 

PC  “ 

probability  that  technology  can  provide 
required  capability 

PC  * 

f  (PL. 

PA) 

where: 

PL  - 

probability  that  LSO  Reverse  Display  , 

has  demonstrated  required  technology 

PA  * 

probability  that  advancing  technology 
can  provide  required  capability 

The  determination  of  Pc  was  made  by  the  senior  training  analyst  for 
this  project.  His  qualifications  for  this  task  included  extensive  experi¬ 
ence  as  a  Navy  LSO  and  over  £hree  and  a  half  years  of  continuous  Involve¬ 
ment  in  LSO  training  research.  This  effort  also  incuded  frequent  Interface 
with  the  LSO  Training  Model  Manager  and  other  experienced  LSOs  regarding 
training  requirements  and  updated  feedback  concerning  the  effectiveness  of 
the  LSORD. 


Soon  after  this  analytical  effort  was  started  it  was  noted  that  the 
subjective  nature  of  the  task  might  cause  some  questions  regarding  credi¬ 
bility.  It  was  therefore  decided  to  provide  two  separate  P$  estimates  for 
each  accident  situation.  The  first  estimate  represents  the  conservative 
fiscal  judgment  of  the  training  analyst.  This  estimate  Is  based  primarily 
on  technological  evidence  as  demonstrated  by  the  LSORD,  and  thus  can  be 
characterized  as  relatively  low  cost,  low  technical  risk.  The  second 
estimate  represents  the  best  technical  judgment  of  the  training  analyst. 
This  estimate  Includes  some  optimism  for  the  near-term  state  of  training 
system  technology. 

The  results  of  this  analytical  effort  were  then  combined  with  the  data 
described  earlier  to  provide  a  range  of  estimated  cost  savings.  Table  8 
shows  the  estimates  of  Pc  an(]  the  resultant  range  of  estimated  cost 
savings,  combined  with  accident  Information  and  LSO  judgments.  Based  on  the 
original  loss  figure  ($57,356,000),  the  estimated  cost  savings  range  from 
over  $21  million  to  over  $32  million  (38  percent  to  56  percent  savings). 
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As  Insight  to  the  operational  value  of  the  estimated  cost  savings, 
they  can  be  converted  Into  numbers  of  replacement  aircraft.  The 
conservative  estimate  of  over  $21  million  equates  to: 


7.5  A-7Es  or, 

1.5  F-14As  or, 

2.6  A-6Es  or, 
8  F-4Ss  or. 


1.2  E-2Cs  or, 
1.5  EA-6BS  or, 
2  S-3As  or, 

2  P-3Cs. 


An  after-the-fact  analysis  of  the  sample  was  performed  to  determine 
whether  It  was  representative  of  current  and  near-term  future  aircraft 
types.  Of  the  51  accidents  In  which  the  LSO  was  cited,  those  with  older 
aircraft  (In  terms  of  current  fleet  deployment)  were  eliminated  leaving  a 
set  of  36  accidents.  This  set  Is  thus  representatl ve  of  current  aircraft. 
It  can  also  be  considered  representative  of  operational  aircraft  for  the 
next  decade,  with  two  exceptions.  The  F/A-18  Is  not  represented  since  It  Is 
not  yet  operational.  The  A-3  derivatives  may  be  phased  out  of  the  fleet 
during  the  coming  decade  due  to  their  age.  From  this  set,  a  representative 
sample  by  aircraft  type  and  other  factors  of  24  accidents  was  calculated 
and  compared  to  the  sample  actually  used.  Table  9  shows  that  the  sample 
which  was  used  does  not  deviate  significantly  from  a  calculated  representa¬ 
tive  sample. 

Additional  analysis  was  performed  to  look  at  the  potential  cost 
savings  associated  with  groups  of  accidents  for  which  the  LSOs  Identified 
similar  training  requirements.  This  was  done  to  gain  insight  to  training 
and  system  capability  priorities.  Table  8,  which  was  presented  earlier 
showed  an  accounting  of  how  often  various  training  requirements  were  Iden¬ 
tified  by  the  LSOs.  Those  which  were  most  frequently  Identified  were  re¬ 
viewed  to  gain  some  Insight  Into  their  value.  For  all  the  accidents  In 
which  one  of  these  frequently  noted  training  requirement  was  Identified, 
the  dollars  lost  and  estimated  cost  savings  w err  summarized.  Except  pos¬ 
sibly  for  waveoff  decision,  the  cost  savings  cannot  be  related  directly  to 
the  training  requirements  due  to  interactions  in  the  waving  process.  The 
results  of  this  analysis  are  summarized  In  Table  10. 

During  this  project,  some  qualitative  Insight  was  gained  Into  other 
potential  benefits  of  an  LSO  training  system.  It  proved  difficult  to  attach 
dollar  values  to  these  benefits  but  they  were  considered  worthy  of  mention, 
due  to  their  potential  Influence  on  procurement  decisions.  Improved  LSO  job 
performance  may  also  result  In  Improved  carrier  landing  boarding  rates, 
thus  enhancing  carrier  operating  efficiency.  The  system  has  the  potential 
to  produce  more  qualified  LSOs,  thus  reducing  an  existing  LSO  workload 

Problem  and  allowing  higher  selectivity  for  critical  LSO  jobs  (such  as 
raining  and  Air  Wing  LSO  billets).  The  system  should  lead  to  improved 
standardization  of  Job  performance.  The  system,  as  envisioned,  could  play 
•an  Important  role  In  refresher  training  for  the  Naval  Air  Reserve  and  for 
LSOs  returning  to  the  fleet  from  duty  In  a  non-LSO  capacity.  Improved  LSO 
job  performance  for  the  waving  task  may  lead  to  Improvements  of  LSO  perfor¬ 
mance  In  the  training  of  pilots. 
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Aircraft  type: 


Day/night: 


Level  of 
damage: 


TABLE  9.  COMPARISON  OF  REPRESENTATIVE  AND  ACTUAL  SAMPLES 


Of  the  36 
Accidents 

Representative 
Sample  of  24 

Actual 
Sample  Used 

A- 3 

4 

3 

0 

TA-4J 

3 

2 

2 

A-6 

2 

1 

2 

A- 7 

13 

9 

10 

F-4 

12 

8 

8 

F-14 

2 

1 

2 

Day 

7 

5 

4 

Night 

28 

19 

19 

Dusk 

1 

0 

1 

A 

16 

11 

12 
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TABLE  10.  TRAINING  REQUIREMENTS  AND  RELATED  ACCIDENTS 


Training  Requirements 

Number  of 
Accidents 

Loss($K) 

Estimated  Cost  Savings 
for  Related  Accidents  (SK) 

Waveoff  decision 

20 

53,749 

19,921 

-  30,144 

Use  of  timely  and  correct 
calls/slgnals 

16 

47,402 

17,998 

-  27,024 

LSO  platform  team  Inter¬ 
action/coordination 

16 

39,853 

14,843 

-  21,809 

Recognizing  approach 
deviations 

14 

48,054 

18,466 

-  27,219 

LSO  knowledge  (procedures, 
rules/limits,  aircraft, 
etc. 

14 

43,812 

15,587 

-  22,296 

Poor  pilot  responsiveness 
to  LSO 

12 

41,028 

14,476 

-  22,023 

Low  pilot  experience 
level 

11 

37,942 

14,686 

-  21,432 
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INTERPRETATION  OF  RESULTS 

The  major  thrust  of  this  analysis  effort  was  to  estimate  potential 
cost  savings  associated  with  an  LSO  training  system  and  to  project  the 
estimates  to  the  future.  All  things  being  equal.  It  would  be  possible  to 
project  that,  for  a  similar  sample,  the  projection  (In  constant  FY80 
dollars)  for  a  future  9-1/2  year  period  would  be  equal  to  the  cost  savings 
estimated  in  this  study.  However,  all  things  may  not  remain  equal  In  the 
future.  There  will  probably  be  variations  In  the  tempo  of  carrier  opera¬ 
tions,  new  fleet  aircraft  will  be  Introduced,  there  may  be  Improvements  In 
carrier  landing  aids  and  general  pilot  skill  levels  may  differ.  Addition¬ 
ally,  the  cost  savings  derived  In  this  study  are  only  for  a  sample  of 
carrier  landings  and  do  not  cover  other  cost  areas  related  to  the  LSO  job 
and  the  LSO  training  program.  The  primary  purpose  of  this  discussion  is  to 
address  projected  cost  savings  for  an  LSO  training  system  based  on  inter¬ 
pretations  of  the  cost  savings  analysis  results.  It  will  also  address  the 
anticipated  impact  of  various  factors  on  this  projection. 

The  first  consideration  In  this  Interpretation  was  to  reassess  the 
credibility  of  the  cost  savings  estimates  derived  through  analysis.  There 
are  several  Indications  that  the  estimates  are  very  conservative.  Only  a 
small  sample  (24)  of  158  accidents  was  used.  This  sample  Included  only 
those  accidents  In  which  the  LSO  was  cited  as  a  causal  factor.  There  is  a 
high  probability  that  improved  LSO  performance  could  have  prevented  some  of 
the  other  accidents  or  otherwise  reduced  the  resultant  dollar  losses.  The 
estimation  process  employed  three  different  probability  factors  with  a 
multiplier  effect  which  essentially  biased  the  results  in  a  conservative 
direction.  The  cost  of  personnel  losses  was  left  out  of  the  estimation 
process.  Uncertainty  In  the  estimation  of  potential  LSO  training  system 
effectiveness  (P$)  was  minimized  by  relying  heavily  on  the  demonstrated 
capabilities  of  the  LSO  Reverse  Display  as  a  foundation  for  technical 
judgment.  Finally,  there  was  a  high  confidence  in  the  judgments  obtained 
from  LSOs  due  to  their  high  levels  of  experience  and  qualifications.  In 
summary,  it  was  concluded  that  the  cost  savings  estimates  were  very  cred¬ 
ible,  and  probably  very  conservative. 

Given  credible  cost  savings  estimates  for  the  period  July  1970  through 
December  1979,  the  next  step  was  to  project  these  estimates  to  future 
carrier  operations.  A  case  can  be  made  that  estimated  cost  savings  would  be 
equaled  or  exceeded  In  a  time  period  of  similar  duration  In  the  near 
future.  The  period  on  which  the  estimate  was  based  appears  to  be  very 
representative  of  carrier  operations  over  the  next  two  decades.  Variations 
In  operations  tempo  included  some  combat  operations  and  some  low  and  high 
levels  of  peacetime  operations.  Transitions  of  new  aircraft  into  the  fleet 
occurred  In  this  period  (F-14,  S-3).  For  the  majority  of  the  period  the 
carrier  landing  accident  rate  was  relatively  low.  The  Automatic  Carrier 
Landing  System  (ACLS)  reached  maturity  In  this  period.  Additionally,  the 
sample  of  accidents  used  Included  aircraft  technology  which  is  very  repre¬ 
sentative  of  that  anticipated  in  the  near  future.  Thus  it  is  reasonable  to 
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expect  cost  savings  of  about  $20  Billion  or  more  for  a  near  term,  ten-year 
period. 

However,  analyses  leading  to  projections  of  future  conditions  always 
have  some  degree  of  risk.  Therefore,  consideration  must  be  given  to  the 
Impact  of  possible  future  Influences  on  the  projection  discussed  above. 
From  a  procurement  decision  perspective,  these  potential  Influences  must  be 
considered,  even  though  they  are  unquantlf lable  and  uncertain. 

Although  the  costs  of  aircraft,  and  therefore  Individual  accidents, 
are  likely  to  Increase  In  the  future,  there  are  several  factors  which  could 
reduce  the  overall  cost  savings  projection.  Some  are  associated  with  poten¬ 
tial  advancements  In  technology.  Factors  which  could  Influence  the  projec¬ 
tion  downward  Include: 

.  Improvements  In  carrier  landing  aids 
.  Improvements  In  aircraft  landing  characteristics 
.  absence  of  Intense  carrier  landing  operations 
.  Improvements  In  carrier  landing  training  for  pilots 
.  higher  retention  rates  for  experienced  pilots  and  LSOs 

Factors  which  could  Influence  the  projection  upward  Include: 

.  higher  unit  costs  for  aircraft  (very  likely  considering  the 
F/A-18;  over  $30  million  each) 

.  more  Intense  levels  of  carrier  operations 

.  emergence  of  new  fleet  aircraft  with  high  accident  potential 

(like  the  F-8  and  RA-5C;  however,  not  likely) 

.  necessity  for  Increased  carrier  operations  under  undesirable 
conditions  (deck  motion,  weather,  no  divert  field,  etc.) 

Additionally,  survey  results  (Section  IV)  were  reviewed  In  conjunction 
with  the  results  of  this  accident  analysis.  The  most  noteworthy  correlation 
was  between  ISO  opinions  of  waveoff  criticality  (Table  2)  and  the  accident 
cost  Implications  of  waveoff  performance  (Table  10).  With  regard  to  situa¬ 
tional  variables,  the  most  obvious  correlation  between  LSO  opinion  (Table 
3)  and  carrier  landing  accidents  (Table  9)  Is  that  of  the  night  enviroment. 
LSO  opinion  regarding  pilot  factors  (Tables  1  and  3)  also  appears  to  be 
supported  In  the  accident  analysis  (Tables  7  and  10).  Other  situation 
variables  which  received  very  high  criticality  ratings  from  LSOs  (Tables  1 
and  3),  such  as  Pitching  Reck,  MOVLAS,  No  Horizon,  No  Divert  and  Reduced 
Visibility,  did  not  show  up  directly  as  major  factors  with  regard  to  the 
cost  Implications  of  carrier  landing  accidents  (Tables  7  and  10).  There  Is 
no  question  that  these  factors  and  others  Increase  the  dlfflclty  of  LSO 
task  performance.  The  fact  that  they  do  not  appear  to  be  major  factors  In 
carrier  landing  accidents  may  be  attributed  to  their  Infrequency  of  occur¬ 
rence.  It  may  also  be  attributed  to  the  fact  that  the  most  experienced  LSOs 
usually  wave  the  recoveries  when  difficult -and  complex  conditions  exist. 
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Reviewing  these  factors  and  considering  that  there  may  be  others, 
leads  this  analyst  to  conclude  that  significant  savings  are  highly 
probable.  Even  using  an  extremely  conservative  projection  that  an  LSo 
training  system  will  only  bring  about  a  10  percent  Improvement  In  overall 
LSO  performance,  the  estimated  cost  savings  should  be  noteworthy.  For  a 
sample  similar  to  that  used  In  this  study,  the  cost  savings  would  be  nearly 
$6  million. 

There  will  obviously  be  costs  associated  with  the  procurement  and 
life-cycle  ownership  of  an  LSO  training  system.  The  return  on  investment 
must  be  one  of  the  major  considerations  In  system  acquisition.  This  study 
provides  quantitative  data  as  insight  to  the  potential  return  on  investment 
for  an  LSO  training  system. 

In  the  next  section,  the  Implications  of  data  and  analyses  presented 
in  this  and  earlier  sections  will  be  discussed  in  the  context  of  the  LSO 
training  program. 
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SECTION  VI 

SUMMARY  OF  LSO  TRAINING  IMPLICATIONS 

The  purpose  of  this  section  Is  to  summarize  the  training  Implications 
of  Information  gathered  and  analyzed  In  the  activities  described  In  prece¬ 
ding  sections  of  this  report.  From  these  activities  evolved  a  "data  base" 
of  job  performance  and  critical  situation  Information.  From  that  "data 
base"  two  separate,  but  related,  sets  of  information  were  extracted  and 
structured  to  support  LSO  training  system  design:  key  concepts  and  training 
situation  variables.  The  key  concepts  are  descriptions  of  what  must  be 
learned  by  the  trainee  for  successful  performance  in  potentially  critical 
situations.  The  training  situation  variables  are  the  conditions  to  which 
the  trainee  must  be  exposed  In  the  learning  process.  Thus  this  section 
provides  a  structured  Informational  foundation  for  the  pilot  and  aircraft 
behavior  models  described  later  In  the  report. 

In  subsequent  portions  of  this  section,  discussions  of  key  concepts 
and  situation  variables  are  preceded  by  a  discussion  of  data  correlation 
and  the  critical  LSO  skill  areas  Identified  In  this  study. 

CORRELATION  OF  DATA 

Before  discussing  specific  results  of  analyzing  LSO  performance  infor¬ 
mation,  It  Is  necessary  to  provide  some  insight  to  how  data  was  correlated 
In  the  analysis.  This  will  also  provide  insight  Into  the  basis  for  LSO 
training  requirements  priorities.  In  general,  the  expert  opinions  of  LSOs 
(Section  IV)  and  other  authors  (Section  III)  were  considered  in  conjunction 
with  accident  analysis  results  (Section  V  and  Appendix  G).  -The  author  then 
used  his  personal  judgment  (based  on  his  LSO  and  hi s  training  analysis 
experience)  to  integrate  the  Information  In  determining  key  concepts  and 
critical  situation  variables.  The  integration  process  first  Involved 
judging  the  level  of  criticality  of  training  requirements  Implied  by  the 
evidence  obtained  In  the  various  Information  gathering  activities  (litera¬ 
ture  review,  survey  and  accident  review).  For  this  judgment,  candidate 
training  requirements  were  loosely  grouped  Into  categories.  Job  perfor¬ 
mance  skills  were  categorized  by: 

waveoff 

aircraft  control  strategies 
recovery  management 

Situation  variables  were  categorized  by: 

pilot 

aircraft 

environment 

operational 
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The  next  step  Involved  a  review  of  the  criticality  levels  Implied  by  the 
evidence  from  each  activity  for  each  category  to  identify  data  correla¬ 
tions. 

As  expected,  waveoff  performance  was  highly  correlated  across  all 
activities.  In  other  words,  expert  LSO  opinions  gave  It  the  highest  criti¬ 
cality  ratings  and  this  was  strongly  supported  by  accident  analysis 
results.  One  aspect  of  the  waveoff  category  which  surfaced  as  highly 
critical  in  the  accident  review  was  the  performance  of  the  backup  LSO. 
This  criticality  was  not  evident  from  the  survey  of  LSOs,  but  later 
received  concurrence  when  the  accident  analysis  results  were  discussed  with 
LSOs.  Within  the  aircraft  control  strategy  category  there  was  concurrence 
among  all  data  sources  of  a  high  level  of  criticality  for  the  use  of 
imperative  voice  calls  (i.e.,  "power,"  "right  for  lineup,"  etc.)  during  the 
“in  close"  segment  of  an  approach.  Within  this  category  there  was  also 
strong  concurrence  on  the  criticality  of  an  LSO's  ability  to  "predict" 
pilot  actions  or  trends  based  on  observation  of  preceding  trends  in  an 
approach.  MOVLAS  performance  was  considered  highly  critical  in  the  survey 
of  LSOs.  However,  this  criticality  was  not  supported  by  evidence  from  the 
accident  review,  probably  because  the  most  experienced  LSOs  are  usually  on 
the  job  when  MOVLAS  is  in  use.  The  recovery  management  category  surfaced 
as  only  a  moderately  critical  aspect  of  the  LSO  job,  although  there  were  a 
few  accident  cases  in  which  LSOs  recovered  aircraft  without  adhering  to 
operational  rules  and  policy.  The  primary  training  requirements  implica¬ 
tion  for  this  aspect  of  LSO  job  performance  is  for  the  very  advanced  stages 
of  training,  such  as  preparation  for  platform  team  leader  and  Air  Wing  LSO 
responsibilities. 

Among  categories  of  situat^n  variables,  tho$e  related  to  the  pilot 
appeared  to  be  the  most  critical;  nd  there  was  strong  concurrence  between 
LSO  opinions  and  accident  analysis  results.  This  was  expeclally  evident 
for  pilot  responsiveness  and  approach  trend  factors.  Pilot  background  (in 
terms  of  experience  and  specific  known  tendencies)  rated  only  a  moderate 
level  of  criticality.  This  was  concurred  upon  by  all  data  sources.  There 
was  also  concurrence  among  data  sources  that  aircraft  factors  had  only  a 
moderate  level  of  criticality.  Although  certain  types  of  aircraft  were 
prevalent  among  the  accidents  analyzed,  pilot  factors  in  controlling  the 
aircraft  appeared  more  important  to  the  context  of  LSO  training  require¬ 
ments.  In  the  category  of  environmental  variables  there  was  concurrence 
that  night  and  pitching  deck  were  highly  critical.  Absence  of  horizon  and 
non-optimum  wind  conditions  were  agreed  upon  as  moderately  critical.  There 
was  concurrence  among  data  sources  that  complex  situations  caused  by  opera¬ 
tional  pressures  (such  as  aircraft  emergencies,  poor  coordination  among 
recovery  personnel  and  complex  combinations  of  undesirable  recovery  condi¬ 
tions)  have  a  moderate  to  high  level  of  criticality.  Even  under  relatively 
uncomplicated  circumstances  there  Is  a  lot  of  operational  pressure  on  the 
LSO  for  recovery  efficiency  and  safety.  However,  cases  of  extremely  high 
levels  of  operational  pressure  are  Infrequent.  Accidents  occurring  under 
these  circumstances  are  even  less  frequent  (which  is  probably  attributable 
to  high  LSO  experience  levels  being  employed  in  such  situations).  There 
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are,  however,  obvious  Implications  that  operational  pressure  situations  are 
Important  training  requirements  for  very  advanced  stages  of  the  LSO 
training  program. 

CRITICAL  SKILL  AREAS 

This  discussion  of  critical  LSO  skill  areas  Is  presented  to  summarize 
the  findings  of  study  activities  described  earlier.  It  also  provides 
background  to  the  utility  of  key  concepts  and  situation  variables  In  LSO 
training.  The  critical  LSO  skill  areas  which  are  discussed  below  are  also 
outlined  In  Table  11. 


TABLE  11.  CRITICAL  SKILL  AREAS 


WAVEOFF 

Decision  Point/Window 
Decision  Factors 
LSO  Team  Interaction 

AIRCRAFT  CONTROL  STRATEGIES 

Expectancy 
Approach  Trends 
Pilot  Tendencies 
Aircraft  Performance 
Complex  Situations. 

RECOVERY  MANAGEMENT  STRATEGIES 

Recovery  Rules/Constraints 
Recovery  Efficiency/Safety 


From  the  evidence  obtained  In  study  activities,  the  waveoff  decision 
overwhelmingly  appears  to  be  the  most  critical  aspect  of  the  LSO  job.  The 
most  vivid  Indicator  of  this  fact  is  the  frequency  In  which  the  waveoff 
factor  appeared  In  carrier  landing  accidents.  There  are  two  aspects  of  the 
waveoff  which  were  found  to  be  critical.  One  was  the  timeliness  of  Issuing 
the  waveoff.  There  were  many  cases  In  which  the  waveoff  was  Issued  too  late 
to  prevent  a  ramp  strike  or  In  which  a  late  waveoff  led  to  an  Inflight 
engagement.  The  other  aspect  was  absence  of  a  waveoff  when  one  was  needed. 
There  were  carrier  landing  accidents  and  reported  near-misses  In  which  no 
waveoff  was  Issued  by  the  LSO.  A  few  of  these  resulted  In  ramp  strikes. 
However,  they  most  frequently  resulted  in  a  hard  landing  or  an  off-center 
engagement.  It  was  also  noted  that  poor  waveoff  decision  performance  by  the 
LSO  was  not  necessarily  associated  with  complex  recovery  situations.  In 
most  cases  the  accidents  and  near-misses  occurred  under  relatively  normal 
circumstances.  This  highlights  the  criticality  of  determining  the  proper 
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waveoff  decision  point,  based  on  aircraft  dynamics  and  trends,  and  pilot 
tendencies.  There  were  cases  in  which  the  situations  were  complicated  by 
the  presence  of  poor  environmental  conditions  (deck  motion,  non-optimum 
wlna,  poor  visibility,  etc.)  or  other  factors  (aircraft  malfunctions, 
operational  pressures,  etc.).  These  cases  highlight  the  criticality  of 
Integrating  multiple  and  complex  factors  into  the  waveoff  decision  process. 
Another  noteworthy  observation  from  the  review  of  accidents  and  from  dis¬ 
cussions  with  LSOs  was  the  disturbing  frequency  of  situations  in  which  the 
backup  LSO  did  not  provide  adequate  support  to  the  controlling  LSO.  Many  of 
the  accidents  could  have  been  prevented  by  issuance  of  a  waveoff  by  the 
backup  LSO.  This  highlights  the  criticality  of  LSO  team  interaction  during 
recovery  situations. 

There  was  also  evidence  that  overall  aircraft  control  strategies  are 
very  critical  to  successful  LSO  performance.  In  many  situations,  effective 
LSO  Interaction  prior  to  the  waveoff  decision  point  In  an  approach  could 
have  minimized  the  necessity  for  a  waveoff.  There  were  many  cases  In  which 
the  LSO  allowed  an  aircraft  to  reach  the  waveoff  decision  point  with  exces¬ 
sive  deviations.  This  Is  Indicative  of  the  criticality  which  should  be 
placed  on  perceptual  and  decision  strategy  skills  in  the  early  to  middle 
segments  of  an  approach.  From  accident  reports  and  LSO  survey  responses,  it 
was  evident  that  there  Is  a  useful  level  of  predictability  in  dynamic 
approach  trends,  pilot  tendencies  and  aircraft  performance.  Skilled  LSO 
performance  requires  a  cognitive  component  of  expectancy  in  the  assessment 
of  approach  dynamics.  The  LSO  must  recognize  dynamic  approach  trends  and 
pilot  tendencies,  be  aware  of  aircraft  performance  capacities,  and  then 
select  actions  (voice  calls  or  light  signals)  which  provide  effective 
aircraft  control  assistance  to  the  pilot.  Both  the  timeliness  and  cor¬ 
rectness  cf  LSO  assistance  are  critical  to  successful  correction  or  effec¬ 
tive  “dampening"  of  approach  deviations. 

As  carrier  landing  situations  Increase  In  complexity,  aircraft  control 
strategy  decisions  can  become  Increasingly  complex  and  difficult.  The 
strategies  of  the  LSO  may  require  modification  in  response  to  the  addi¬ 
tional  recovery  factors.  For  example,  LSO  actions  may  have  to  be  initiated 
earlier  than  usual,  more  voice  calls  may  be  needed,  imperative  voice  calls 
may  be  necessary  In  cases  where  Informative  calls  are  typically  appro¬ 
priate.  Some  conditions  which  can  lead  to  these  types  of  adjustments  In  LSO 
performance  Include  the  existence  of  adverse  environmental  conditions, 
aircraft  malfunctions,  pilot  disorientation  or  lack  of  proficiency,  MOVLAS 
utilization,  communications  failure,  etc.  The  decision  processing  for  a 
skilled  LSO  must  Include  cognitive  schemes  to  guide  aircraft  control 
strategy  adjustments  in  response  to  many  variances  In  approach  situations. 

The  LSO  also  plays  a  critical  role  in  the  management  of  the  overall 
recovery  process.  Failures  of  LSOs  In  fulfilling  their  recovery  management 
duties  have  been  noted  or  implied  in  carrier  landing  accident  reports.  The 
LSO  must  monitor  recovery  conditions  to  Insure  adherence  to  operating 
policies  and  rules  associated  with  factors  such  as  weather  conditions  and 
pilot  proficiency.  He  must  insure  that  shipboard  and  aircraft  operating 


54 


ml:* 


^  ^  *W 


NAYTRAEQUIPCEN  80-C-0063-2 


limitations  are  not  exceeded  due  to  such  factors  as  adverse  Mind  conditions 
and  deck  motion.  He  must  be  alert  for  Indications  of  Improper  approach 
geometry  caused  by  mlstrlm  of  the  ship  or  malfunction  of  the  Fresnel  lens. 
He  must  determine  the  need  for  utilization  of  the  MOVLAS,  and  changes  In 
targeted  touchdown  point.  He  Is  responsible  for  managing  the  Interaction 
among  the  members  of  the  LSO  platform  team  to  preclude  excessive  task 
loading  on  the  controlling  LSO  In  adverse  recovery  conditions.  He  must  keep 
Primary  Flight  Control  (PRI-FLY)  a^  Carrier  Air  Traffic  Control  Center 
(CATCC)  Informed  of  unusual  operating  conditions  and  actively  participate 
In  the  coordination  of  appropriate  actions  and  establishment  of  operating 
priorities.  He  must  Insure  that  safety  Is  not  jeopardized  due  to  the  exis¬ 
tence  of  operational  pressure  for  Increased  boarding  rate.  If  he  judges 
that  operating  conditions  exceed  pilot  capabilities,  he  Is  obligated  to 
recommend  the  cancellation  of  recovery  operations. 

In  summary,  the  LSO  performance  skills  which  must  receive  highest 
priority  are:  waveoff  decision,  expectancy  of  pilot  behaviors  based  on 
observed  trends,  and  the  ability  to  Integrate  multiple  recovery  factors 
Into  the  decision  processes  Involved  with  waving. 

KEY  CONCEPTS 

Many  of  the  global  aspects  and  discrete  components  of  the  LSO  job  have 
been  researched,  analyzed  and  reported  In  previous  studies  (referenced  in 
Section  III).  However,  within  the  LSO  training  program,  there  has  been 
minimal  attention  and  documentation  of  the  concepts  and  cognitive  relation¬ 
ships  Inherent  in  the  decision  process  of  the  LSO.  These  were  recognized  by 
researchers  and  the  current  LSO  Training  Model  Manager  as  important  ingre¬ 
dients  for  helping  the  LSO  trainee  develop  cognitive  structures  for  effec¬ 
tive  decision-making  In  the  almost  Infinite  number  of  critical  situations 
which  can  arise  in  the  carrier  landing  environment.  For  LSO  training  system 
design  these  "key  concepts"  are  necessary  Influences  In  the  design  of  the 
syllabus  and  decision  logic  for  the  training  process,  the  specification  of 
training  situation  variables,  and  the  design  of  performance  evaluation 
schemes.  The  key  concepts  which  were  identified  In  this  study  are 
delineated  In  Appendix  0. 

The  key  concepts  evolved  Iteratively  through  efforts  of  the  project 
training  analyst  and  the  LSO  community.  The  first  set  of  key  concepts  were 
generated  by  the  training  analyst  based  on  review  of  job  performance  and 
critical  situation  Information  obtained  In  the  documentation  review  and 
initial  LSO  survey  responses.  This  set  was  then  submitted  to  the  LSO 
Training  Model  Manager  for  review  and  feedback.  Other  iterations  Involved 
incorporation  of  additional  information  from  later  LSO  survey  responses, 
analysis  of  carrier  landing  accidents  and  the  LSO  review  of  accidents 
during  the  cost  savings  estimation  effort.  The  Commander  Naval  Air  Forces 
Atlantic  Fleet  (COMNAVAIRLANT)  and  Commander  Naval  Air  Forces  Pacific  Fleet 
(COMNAVAIRPAC)  LSOs  were  also  included  In  the  review  and  feedback  process. 
There  was  also  Interaction  with  the  Canyon  Research  Group  analyst  for  the 
Instructor  model  study  throughout  this  effort. 
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A  part  of  this  effort  was  the  structuring  of  key  concepts  Into  related 
groupings.  The  Initial  taxomony  utilized  In  this  effort  Involved  categori¬ 
zation  of  the  key  concepts  by  situation  factors,  such  as  pilot,  aircraft, 
environment,  ship,  etc.  However,  some  that  were  not  identifiable  with  situa¬ 
tion  factors  were  grouped  separately. 

The  key  concept  statements  vary  greatly  In  level  of  specificity.  Some 
are  very  general  descriptions  of  LSO  decision  considerations  In  the  carrier 
landing  process.  Others  are  very  specific  rules  to  guide  LSO  performance  of 
duties.  Most  of  the  key  concept  statements  express  or  imply  the  relation¬ 
ships  between  situation  factors  and  LSO  actions  or  decisions.  One  critical 
relationship  which  shows  up  frequently  in  the  key  concept  listing  is  the 
relative  positioning  of  the  waveoff  decision  point  based  on  such  factors  as 
pilot  characteristics,  aircraft  type  and  environmental  conditions.  Several 
are  precautionary  statements  of  situation  relationships  (“If.  .  .be  alert 
for.  .  .").  Many  of  the  key  concepts  provide  guidance  on  what  to  do  when 
certain  conditions  exist  or  certain  events  occur  (“If/when.  .  .the  LSO 
should.  .  .").  There  are  also  several  concepts  which  express  basic  "do's" 
and  "don'ts"  of  LSO  performance  ("The  LSO  should  always.  .  ."  or  "The  LSO 
should  never.  .  ."). 

The  set  of  key  concepts  resulting  from  this  study  Is  quite  extensive. 
However,  It  cannot  be  considered  exhaustive,  nor  can  the  statements  them¬ 
selves  be  considered  firm.  This  Is  due  to  the  nearly  Infinite  number  of 
carrier  landing  situations  which  can  occur  and  to  the  variety  of  individual 
waving  styles  and  techniques  which  exist  within  the  LSO  community.  This 
set  of  key  concepts  should  continue  growing  and  evolving  into  more  speci¬ 
fic  cognitive  performance  guidance  as  a  part  of  LSO  training  system  de¬ 
velopment,  as  well  as  ongoing  LSO  training  program  management  and  quality 
control.  During  an  LSO  training  system  development  effort,  critical  atten¬ 
tion  should  be  devoted  to  the  evolution  and  validation  of  key  concepts, 
both  by  LSO  subject  matter  experts  and  training  specialists.  Additional 
analyses  of  carrier  landing  accidents  and  surveys  for  additional  lessons 
learned  from  "close  calls"  are  recommended  activities  during  system  devel¬ 
opment.  Ongoing  training  program  management  and  quality  control  should 
Include  continual  and,  preferably,  formal  LSO  Training  Model  Manager  inter¬ 
action  with  the  Naval  Safety  Center  (as  suggested  In  Appendix  H),  the  type 
commander  LSOs  and  Air  Wing  LSOs.  The  goals  of  such  interaction  would  be  to 
Identify  needed  changes  In  training  program  content  and  emphasis  and  to 
ensure  effective  utilization  of  training  program  resources,  particularly 
the  LSO  training  system(s). 

SITUATION  VARIABLES 

The  study  activities  described  earlier  In  the  report  were  Instrumental 
In  Identifying  situation  variables  requiring  attention  in  LSO  training. 
These  variables  were  the  basis  for  pilot  and  aircraft  behavior  models  which 
could  present  meaningful  exercise  conditions  In  an  LSO  training  systems 
context. 
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Several  logical  segmentations  surfaced  among  the  situation  variables. 
Initial  groupings  Included:  pilot,  aircraft  and  environment.  The  pilot 
related  variables  were  representative  of  aircraft  control  and  response  (to 
ISO)  characteristics.  Aircraft  related  variables  were  representative  of 
variances  In  performance  among  different  types  of  aircraft  and  among  dif¬ 
ferent  aircraft  malfunctions.  Environmental  variables  Included  phenomena 
such  as  nlght/day,  wind,  carrier  deck  motion  and  visibility.  However, 
additional  segmentations  were  found  to  be  required  to  account  for  ship  and 
operational  conditions. 

As  variables  were  identified  they  were  Iteratively  labeled  and  grouped 
to  develop  a  structure  which  was  considered  comprehensive  and  logical.  The 
final  s»?t  of  labels  and  groupings  was  also  designed  for  ease  of  association 
with  specific  LSO  training  situations  and  for  flexibility  of  manipulation 
for  generating  exercises.  The  structure  is  summarized  In  Table  12  and 
discussed  below.  Additional  detail  Is  provided  later  In  discussions  and 
descriptions  of  models. 


TABLE  12.  STRUCTURE  OF  SITUATION  VARIABLES 
PILOT: 

Pilot  Characteristics 

Approach  Profile  (aircraft  control) 

Response  to  LSO 

AIRCRAFT: 

Performance  Characteristics 
Malfunctions 

ENVIRONMENT: 

Day /Night 
Deck  Motion 
Visibility 
Wind 
Horizon 

SHIP: 


Specific  Carrier 
Recovery  Aids/Equipment 
LSO  Job  Aids 
Ship  Trim 

OPERATIONAL: 


Type  Recovery 
Recovery  Pressure  Factors 


E 
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From  earlier  analytical  activities  It  was  noted  that  the  decision 
processes  and  actions  of  a  skilled  LSO  are  Influenced  by  several  pilot 
factors.  Some  factors  are  related  to  the  known  ("a  priori")  characteristics 
of  the  pilot.  These  Include  his  experience  and  proficiency  levels,  his 
track  record  of  carrier  landing  performance  and  specific  flying  tendencies. 
Others  are  related  to  real  time  events  or  trends  which  are  observable  by 
the  LSO  during  an  approach.  These  Include  the  dynamic  profile  flown  by  the 
pilot  during  approach  and  the  responses  of  the  pilot  to  LSO  voice  calls  and 
signals. 

The  performance  of  the  skilled  LSO  Is  also  Influenced  by  aircraft 
factors.  Each  type  of  aircraft  has  different  performance  characteristics. 
Some  of  these  characteristics  Include  approach  speed,  gl  1 deslope/1 Ineup/AOA 
control  stability,  power  response  for  waveoffs,  attitude  sensitivity,  etc. 
Visual  characteristics,  such  as  exterior  lighting,  also  differ  by  aircraft 
type.  There  are  many  aircraft  malfunctions  which  affect  performance  charac¬ 
teristics.  Some  also  affect  aircraft  visual  characteristics. 

Environmental  factors  also  have  some  Impact  on  carrier  landing  situa¬ 
tions.  The  night  environment,  carrier  deck  motion  due  to  sea  state,  re¬ 
stricted  visibility  and  absence  of  a  visible  horizon  negatively  affect  LSO 
perception  of  cues  during  an  aproach.  Non-optimum  wind  conditions  have  an 
effect  on  aircraft  dynamics  during  approach.  The  skilled  LSO  has  learned  to 
adjust  his  performance  In  response  to  the  existence  of  variations  In  these 
conditions. 

Skilled  LSO  performance  must  also  be  responsive  to  variations  In 
conditions  related  to  the  ship.  There  are  configuration  and  LSO  platform 
position  differences  among  different  carriers.  Malfunctions  of  recovery 
aids  and  equipment  such  as  the  Fresnel  lens  and  the  arresting  wires  have  an 
effect  on  the  conduct  of  carrier  landing  operations.  Malfunctions  of  LSO 
workstation  controls  and  displays  can  affect  the  LSO's  job.  The  geometry  of 
the  carrier  landing  process  Is  affected  by  the  lack  of  proper  ship  trim. 

The  pace,  complexity  and  difficulty  of  the  LSO  job  In  carrier  landing 
operations  can  be  Influenced  by  several  operational  factors.  The  type  of 
recovery  may  Involve  various  numbers  of  aircraft  approaching  at  very  close 
Interval.  There  may  be  pressure  to  expedite  the  recovery  process  due  to 
Impending  weather  problems,  low  fuel  state  aircraft,  lack  of  a  divert 
field,  lack  of  an  airborne  tanker,  etc.  The  skilled  LSO  must  be  able  to 
keep  these  factors  In  proper  perspective  and  avoid  jeopardizing  the  safety 
aspects  of  the  carrier  landing  process. 

In  summary,  the  situation  variables  which  must  receive  the  highest 
priority  are:  undesirable  pilot  responses  and  approach  trends,  variations 
In  aircraft  performance  characteristics  (particularly  engine  response  and 
attitude  sensitivity),  night  environment  and  deck  motion. 
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SUMMARY 

The  preceding  discussions  of  critical  skill  areas,  key  concepts  and 
situation  variables  summarize  the  requirements  for  LSO  training  system 
pllot/alrcraft  behavior  models  based  on  the  review  and  analysis  activities 
described  In  earlier  sections.  The  discussions  also  provide  Insight  to 
training  priorities  and  to  the  training  requirements  which  will  be  sup¬ 
ported  by  automated  Instructor  model  functions  In  an  LSO  training  system. 

The  next  section  addresses  the  development  of  pllot/alrcraft  behavior 
models  and  a  functional  design  for  their  Incorporation  Into  an  automated 
LSO  training  system. 
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SECTION  VII 

PILOT/AIRCRAFT  MODELS  DEVELOPMENT 

The  purpose  of  this  section  is  to  discuss  pilot  and  aircraft  behavior 
models  for  LSO  training  systems.  This  section  includes  a  description  of 
model  development  and  functional  design  activities  and  a  discussion  of 
results.  The  actual  results  of  these  activities  are  presented  In  Appendix  E 
( P 1 1 ot/Aircraft  Behavior  Models)  and  Appendix  F  (Functional  Design  for 
Model s) . 


MODEL  DEVELOPMENT  AND  FUNCTIONAL  DESIGN 

The  model  development  and  functional  design  activities  had  their 
beginnings  during  study  planning  efforts.  Based  on  a  preliminary  review  of 
technical  reports,  tentative  pilot  aircraft  and  environmental  models  and 
elements  were  Identified  for  pilot,  aircraft  and  environmental  factors. 
Additionally  a  tentative  structure  of  LSO  training  system  functions  was 
defined. 

During  subsequent  training  analysis  activities,  there  was  periodic 
Input  of  results  to  an  iterative  model  formulation  effort.  There  was 
periodic  review  and  feedback  by  the  LSO  Training  Model  Manager  during  model 
formulation,  as  well  as  interaction  with  instructor  model  development 
personnel . 

Concurrent  with  model  formulation  was  the  identification  and 
definition  of  functions  to  support  model  interactions  within  an  automated 
LSO  training  system  context.  This  involved  llason  with  instructor  model 
development  personnel  for  compatibility  of  overall  system  functional  design 
concepts  and  structures. 

Following  completion  of  training  analysis  activities,  model  develop¬ 
ment  activity  Intensified  to  complete  the  structuring  of  models  and  ele¬ 
ments  and  to  specify  attributes,  values  and  Interrelationships  among  model¬ 
ling  variables.  The  functional  design  activity  was  completed  with  the  final 
specification  of  model  support  function  interactions  and  system  interfaces. 

Subsequent  paragraphs  briefly  describe  the  models  and  their  roles  in 
an  automated  LSO  training  system  context.  Detailed  results  are  presented  in 
Appendix  E  and  Appendix  F. 


SYSTEM  CONTEXT  FOR  MODEL  IMPLEMENTATION 

The  concept  of  an  automated  LSO  training  system  Is  to  provide  instruc¬ 
tional  support  for  a  variety  of  LSO  training  requirements,  from  basic 
through  advanced  skill  levels.  The  concept  includes  several  required 
functional  characteristics.  It  Includes  visual  simulation  and  control  of 
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carrier  landing  situations  from  the  LSO  workstation  perspective.  It  enables 
LSO  task  Interaction  with  a  simulated  pilot  during  the  landing  process.  The 
concept  also  Includes  automated  support  for  Instructor  functions.  Within 
this  support  are  curriculum  control,  exercise  selection,  trainee  evaluation 
and  recording  of  trainee  progress.  The  concept  Includes  support  for  both 
Instructor-present  and  Instructor-absent  modes  of  operation. 

The  primary  goal  of  concept  application  Is  to  promote  the  acquisition 
of  judgmental  skills  needed  by  the  LSO  in  the  carrier  landing  operations 
environment.  The  training  scope  Is  Intended  to  encompass  perceptual  and 
decision  skills  oriented  to  the  development  of  cognitive  processing  of  the 
Interrelationships  among  cues,  decision  factors  and  appropriate  LSO 
actions.  To  accomplish  this,  the  concept  calls  for  simulation  and  control 
of  many  situation  variables  related  to  the  pilot,  aircraft  and  other  criti¬ 
cal  factors  associated  with  successful  LSO  performance. 

There  are  three  technological  areas  which  were  recognized  as  partic¬ 
ularly  important  to  the  automated  LSO  training  system  concept.  Automated 
speech  recognition  (and  understanding)  Is  a  key  functional  element  in  the 
representation  of  the  results  of  LSO  interaction  with  the  simulated  pilot. 
The  most  critical  aspect  of  speech  recognition  for  pilot  model  Implementa¬ 
tion  Is  time.  For  effective  training  transfer,  the  time  from  voice  call  to 
pilot  response  must  closely  replicate  actual  behavior  for  the  critical 
pilot  tendencies  being  simulated.  Visual  simulation  and  control  technology 
Is  critical  to  effective  presentation  of  the  LSO's  primary  cues  during  the 
simulated  carrier  landing  process.  The  technology  of  automated  "intelli¬ 
gence"  Is  Important  to  the  efficiency  and  training  effectiveness  of  sylla¬ 
bus  control,  and  for  minimizing  instructor  workload  and  dependency  on 
Instructor  availability. 

The  pilot  and  aircraft  behavior  models  provide  the  functional  require¬ 
ments  basis  for  simulation  and  control  of  carrier  landing  situations  for 
LSO  training.  The  most  Important  aspect  of  modelling  pilot  behavior  is  the 
representation  of  pilot  characteristics  which  are  most  critical  to  suc¬ 
cessful  LSO  performance.  Variations  in  characteristics  of  pilot  response 
to  LSO  actions  Is  one  critical  modelling  area.  The  other  is  associated  with 
variations  In  the  simulated  approach  profiles  presented  to  the  LSO.  The 
most  critical  aspects  of  aircraft  modelling  are  associated  with  the  repre¬ 
sentation  of  differences  In  aircraft  performance  characteristics  and  the 
effects  of  aircraft  system  malfunctions.  The  modelling  effort  also  add¬ 
ressed  other  training  situation  factors,  but  not  as  comprehensively  as 
pilot  and  aircraft  factors. 

The  functional  design  provides  software  design  and  development  guid¬ 
ance  for  Implementation  of  the  models  into  an  LSO  training  system.  It 
presents  the  overall  automated  LSO  training  system  functional  structure  and 
delineates  the  system  functions  needed  to  support  model  operations  and 
Interfaces  within  the  overall  system.  Particular  attention  is  devoted  to 
the  relationships  with  automated  instructor  model  functions.  Attention  is 
also  devoted  to  software  detailed  design  and  program  control  considerations 
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such  as  modularity,  design  flexibility,  design  language  selection  and  data 
management  within  the  system. 

Implementation  of  the  enclosed  models  and  functional  design  will 
require  extensive  human  factors,  training  analysis,  and  subject  matter 
expertise  during  development  and  testing.  This  will  be  necessary  In  order 
to  ensure  that  training  effectiveness  potential  Is  not  reduced  due  to  lack 
of  user  acceptance.  Extensive  Involvement  of  this  type  of  expertise  will 
also  be  necessary  to  provide  proper  training  goal  orientation  to  any  design 
and  development  trade-off  decision  situations  which  may  arise.  Follow-up 
use  of  the  data  and  analysis  concepts  presented  in  earlier  portions  of  this 
report  (Sections  III,  IV  and  Y)  and  in  Appendix  G  should  be  very  useful 
during  detailed  design  and  development. 
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SECTION  VIII 


CONCLUSIONS  AND  RECOMMENDATIONS 


1.  An  LSO  training  system  which  can  present  Interactive  waving  situa¬ 
tions,  with  Instructional  emphasis  on  critical  situations,  would  be  a  cost- 
effective  Improvement  for  the  LSO  training  program.  (See  pages  6,  48-50) 

2.  LSO  trainee  experience  with  a  variety  of  simulated  waving  situations 
can  have  a  positive  impact  on  the  development  of  effective  cognitive  pro¬ 
cessing  skills.  (See  pages  55,  56) 


3.  Representation  of  pilot  behavior  and  aircraft  characteristics  through 
modelling  functions  are  the  most  Important  simulation  aspects  of  an  LSO 
training  system.  (See  pages  52,  58) 


4.  Automated  speech  recognition  processing  time  Is  critical  to  the  effec¬ 
tive  representation  of  pilot  response  to  LSO  actions.  (See  pages  54,  61) 


5.  An  extensive  follow-up  effort  Is  needed  for  comprehensive  detailed 
design  of  a  training  requirements  data  base  and  for  specific  correlation  of 
the  requirements  to  the  situation  variables  identified  in  this  study. 
(See  pages  62,  170,  171) 

6.  It  is  recommended  that  consideration  be  given  to  the  implementation  of 
pilot  modelling  functions  In  the  LSO  Reverse  Display  for  timely  assessment 
of  the  automated  pilot  concept.  This  should  also  enhance  the  effectiveness 
of  the  device.  (See  pages  15,  167,  168,  170,  171) 


7.  To  insure  user  acceptance  and  training  effectiveness,  the  LSO  training 
system  development  process  will  require  extensive  and  continuous  involve¬ 
ment  by  subject  matter  expert,  training  analysis  and  human  factors  per¬ 
sonnel.  (See  pages  61,  170,  171) 

8.  To  Increase  the  effectiveness  of  an  LSO  training  system  within  the 
overall  LSO  training  program,  a  total  training  program  analysis  and  design 
effort  should  be  undertaken.  (See  pages  55,  56) 

9.  The  Naval  Safety  Center  Is  an  excellent  source  of  data  for  the  LSO 
Training  Model  Manager  to  use  In  monitoring  training  program  effectiveness 
and  for  Identifying  training  program  emphasis  needs.  (See  pages  19-21,  33- 
35,  208,  225) 


10.  The  waveoff  decision  Is  by  far  the  most  critical  skill  component  of 
the  LSO's  job.  (See  pages  17-19,  26,  45,  52,  53,  54) 
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APPENDIX  A 


STUDY  OBJECTIVES 


1.  Identify  Critical  Aspects  of  LSO  Waving  Tasks  -  This  objective  was 
fundamental  to  the  determination  of  modelling  requirements  which  could  have 
a  positive  Impact  on  LSO  training.  The  study  resulted  in  the  comprehensive 
compilation  of  key  LSO  learning  concepts  and  critical  situation  variables. 
Achievement  of  this  objective  was  considered  very  successful. 

2.  Identify  Potential  Cost  Savings  of*  Improved  LSO  Training  -  This  objec¬ 
tive  was  Important  to  the  verification  that  LSO  training  research  activi¬ 
ties  and  results  can  have  a  positive  impact  on  LSO  training.  The  objective 
was  also  Important  In  providing  procurement  decision-makers  with  quantita¬ 
tive  indications  of  potential  return  on  Investment.  Achievement  of  this 
objective  was  considered  very  successful. 

3.  Develop  Pilot/Aircraft  Behavior  Models  For  Presentation  of  Situations 
to  Help  LSO  Trainee  Acquire  Key  Waving  Concepts  and  Critical  Skills  - 
Excellent  progress  was  made  In  the  compilation  of  pilot,  aircraft  and  other 
situation  variables  needed  for  effective  LSO  training.  Additional  model 
detail  will  be  required  prior  to  detailed  software  design  of  model 
functions. 

4.  Develop  Functional  Design  For  Incorporation  and  Use  of  The  Models  In 
An  Automated  LSO  Training  System  -  The  functional  design  resulting  from 
this  study  should  provide  excellent  top  level  guidance  for  detailed  design 
of  software  for  the  models  and  for  interactions  within  the  LSO  training 
system. 
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APPENDIX  B 

SURVEY  QUESTIONNAIRE  AND  DATA 
LSO  TRAINING  SURVEY 

NTEC,  In  conjunction  with  the  LSO  Training  Model  Manager,  Is  In  the 
process  of  Identifying  critical  aspects  of  "waving"  which  are  most  Important 
to  successful  trainee  progression  to  a  Wing  LSO  designation.  Mathetlcs,  Inc., 
under  contract  to  NTEC,  Is  surveying  the  LSO  community  for  Information  to 
support  this  effort.  Since  the  results  of  this  survey  will  eventually  be  used 
In  the  LSO  training  program.  It  Is  very  important  that  there  be  broad  LSO 
participation  In  this  survey  and  that  the  questions  be  answered  diligently 
and  with  careful  consideration.  Many  of  the  questions  require  only  that  you 
check  blocks  to  rate  certain  aspects  of  waving.  However,  other  questions 
require  narrative  descriptions  of  your  waving  experiences. 

Personal  Identification  data  Is  desired  In  order  to  allow  possible 
future  follow-up.  However,  If  an  anonymous  submission  Is  preferred,  please 
provide  the  Information  requested  to  describe  your  background. 

For  questions  or  suggestions  about  the  survey  or  help  with  questionnaire 
completion,  contact  LCDR  Jerry  Singleton  of  the  LSO  School  at  NAS  Cecil  Field 
(AUTOVON  860-6267)  or  Mr.  Thel  Hooks  of  Mathetlcs,  Inc.,  In  San  Diego  (commer¬ 
cial  714-578-5931).  If  returning  this  questionnaire  by  mail,  please  send  it 
to  the  following  address: 

Mathetics,  Inc. 

P.0.  Box  26655 

San  Olego,  Ca.  92126 


Date 

Name _ Unit  _ Phone _ 

18  ■  Staff 

LSO  Qua!  Level  14  »  Wing  Years  since  starting  LSO  training  7.09 
Carrier  landings  261 . 3  day,  88.5  night  Cruises  Completed  2.9 
Primary  aircraft  type  as  pilot  A-7«12,  F-4»8,  F-14«6,  A-6=5 


Aircraft  which  you  are  qualified  to  wave:  All  covered  except  F/A-18 
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1.  Below  ere  listed  many  of  the  variables  thet  cen  effect  e  night  waving 
situation  for  a  Wing  Quel  ISO.  Your  Inputs  ere  needed  to  help  establ ish 
priorities  for  their  emphasis  In  the  training  process  leading  up  to  Wing 
ISO  designation.  In  considering  you r  ratings  of  these  variables  several 
factors  should  influence  your  opinion: 

-  How  much  the  variable  can  affect  recovery  safety 

•  How  much  the  variable  can  effect  boarding  rate,  especially 
when  there  Is  a  real  need  to  expedite  recovery 

*  Difficulty  experienced  by  a  trainee  In  learning  how  to  wave 
approaches  with  the  variable  present 

Please  rate  each  situation  variable  using  the  following  scale: 

1  «  No  training  emphasis  required 

2  «  Low  priority 

3  ■  Moderate  priority 

4  ■  High  priority 

5  »  Extremely  high  priority 


SITUATION  VARIABLES 

Pilot  unresponsive  or  very  slow  to 
respond  to  LSO 

Very  unproficient  pilot 

Very  Inexperienced  pilot 

Very  unpredictable  pilot 

LSO  talkdown 

N0R00 

Pitching  deck,  clear  horizon 

MOVLAS,  steady  deck 

No  horizon,  no  plane  guard  destroyer 

Aircraft  breaking  out  of  MX 
inside  3/4  mile 

Barricade  recovery 

Extremely  high  or  low  WOO 

Recovery  crosswind 

Aircraft  without  external  AOA  Indexers 

Aircraft  without  wing  tip  lights 

Pitching  deck,  MOVLAS,  no  horizon 

Single  engine  approach  (twin 
engine  aircraft) 

"Trick  or  treat"  pass,  no  tanker, 
no  divert 


1 

2 

3 

4 

5 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

4.12 

3.41 

3.59 

4.06 

3.97 

3.24 

3.94 

4.20 

3.89 

3.88 

3.74 

3.38 

3.06 

3.06 

3.35 

4.20 

3.67 

4.03 
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(Continued) 


SITUATION  VARIABLES 

Pitching  deck,  no  horizon 

No.  3  end  4  wires  missing 

Loss  of  LSO  radio  after  ball  cal) 

MOVLAS.  pitching  deck 

Aircraft  flight  control  emergency 

Higher  than  norma)  approach  speed 
configuration 

Extremely  poor  start  off  CCA 

Other : _ 

Other:  _ 

Other:  _ 


4.32 

3.4) 

3.)5 

4.29 

3.9) 

3.26 

3.88 


Comments,  as  desired: 


c*7 

$ 

be: 

s 

■  ■ 

i  V 

> 

| 

1 

TTTrvr  r.  tt*  .  »  •.’  -.*  ■■  -.  ■  -  *.  -.  .*■  .  .'  .  ;*r. '•  -  •  \-\.  *  '• 
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2.  Please  rate  the  following  ISO  voice  calls  for  their  criticality  to 
successful  LSO  'waving"  performance  under  night  carrier  landing  condl* 
tlons,  at  the  Wing  LSO  designation  level.  The  results  of  your  ratings 
will  help  establish  priorities  for  voice  call  emphasis  In  LSO  training. 

A  scale  of  0-5  Is  provided,  where: 

0  •  Do  not  feel  It  should  ever  be  used 

1  •  Definitely  not  critical 

2  ■  Possibly  critical 

3  •  Fairly  critical 

4  •  Definitely  critical 

5  ■  Extremely  critical 

■  •  W] 

.  ■  .• 

-  \ 

VOICE  CALLS 

0 

1 

2 

3 

4 

5 

V. 
■  r> 

A  little  power 

X 

3.30 

i 

Power 

4.65 

Go  manual 

X 

2.65 

A  little  attitude 

JL 

3.03 

k  < 

Attitude 

JL 

3.74 

u 

Right  for  lineup 

-X- 

4.26 

Jt  * 
.•** 

Left  for  lineup 

3.43 

>> 

Bolter 

X 

2.59 

Waveoff 

X 

4.74 

-*1 

i 

Uaveoff,  foul  deck 

JL 

3.61 

Cut 

2.26 

£ 

Uncouple 

X 

2.70 

l: 

Check  your  lineup 

X 

1.85 

1 

Don't  settle 

X 

3.03 

Don't  go  low 

X 

3.03 

N  , 
V 

Don't  climb 

JL 

2.85 

Don't  go  high 

JL 

2.50 

« 

Keep  your  nose  up 

Jl 

0.76 

Hold  your  attitude 

JL 

2.18 

Hold  what  you've  got 

JL 

2.68 

You're  a  little  high 

X 

2.62 

i 

You're  high 

JL 

3.00 

■s.  ; 

You're  a  little  low 

X 

2.91 

jj 

You're  low 

X 

3.62 

£ 

ii 

You're  going  high 

jl 

2.26 

You're  going  low 

JL 

2.79 

1 

You’re  lined  up  left 

X 

2.35 

You’re  lined  up  right 

JL 

2.38 

ft 

s 

s* 

/.* 
v' . 
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Continued 


VOICE  CALLS 

□ 

0 

3 

3 

□ 

a 

You're  fast 

■ 

■ 

9 

■ 

a 

B 

You're  slow 

■ 

3 

You’re  drifting  left 

X 

You're  drifting  right 

X 

Roger  Bell 

X 

Paddles  Contact 

X 

A  little  left  for  lineup 

X 

A  little  right  for  lineup 

X 

Hold  It  up 

X 

Fly  the  ball 

X 

Fly  it  down 

X 

Catch  it 

X 

The  deck  is  moving 

■ 

■ 

a 

Stop  it  in  the  middle 

B 

X 

Don't  go  through  it 

- 

X 

You're  settling 

■ 

■ 

■ 

a 

Ease  It  down 

■ 

■ 

9 

a 

Start  it  down 

a 

a 

a 

Start  it  back  to  the  left 

■ 

a 

► 

Start  It  back  to  the  right 

■ 

a 

Uork  it  up 

JL. 

A  little  power,  right  for  lineup 

JL. 

A  little  power,  left  for  lineup 

You're  high,  ease  it  down 

J L_ 

Check  your  lineup,  don't  go  low 

■ 

■ 

A  little  power,  don't  climb 

B 

H 

The  deck  Is  moving,  don't  chase  the  ball 

JL. 

You're  low  and  slow 

■ 

Other: 

B 

Other: 

■ 

Other: 

B 

Other: 

■ 

i 

Comments,  as  desired: 


2.44 

2.91 
1.94 

1.91 

3.58 

3.88 
1.97 
2.33 
1.50 
2.74 

1.58 

2.09 

2.59 

1.88 
2.38 
2.88 
1.83 
2.47 
2.53 

2.53 

1.56 
2.82 
2.61 
2.42 

1.53 
1.24 

2.56 
2.85 
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3.  Please  describe  three  of  the  most  difficult  (or  "hairiest”)  waving  situa¬ 
tions  you  have  experienced.  These  may  have  occurred  when  you  were  a 
controlling  or  observing  LSO,  or  when  you  were  In  the  aircraft.  Maximum 
detail  surrounding  each  situation  Is  desired.  To  help  In  your  descrip¬ 
tion,  a  check-off  list  for  many  of  the  possible  situation  variables  Is 
Included.  Please  provide  a  chronological  narrative  of  the  approach 
Including  a  description  of  the  profile  flown  by  the  aircraft.  Also 
provide  commentary  regarding  what  the  LSO's  actions  were,  and  how.  In 
retrospect,  the  LSO  could  have  done  a  better  job  of  waving  the  approach 
In  terms  of  calls  used  and  the  timing  of  calls.  There  is  no  Intent  here 
to  "hammer"  the.  LSO,  only  to  learn  from  previous  experiences.  The  Intent 
Is  to  identify,  and  detail,  critical  situations  for  which  an  LSO  must  be 
prepared.  Therefore  priority  should  be  on  describing  situations  from 
which  LSO  performance  lessons  can  be  learned.  Situations  resulting  in 
accidents  which  were  (or  may  have  been)  preventable  by  LSO  actions  are 
of  particular  Interest.  This,  however,  does  not  necessarily  imply  that 
the  LSO  caused  the  accident;  just  that  by  doing  something  different,  he 
may  have  prevented  or  reduced  the  probability  of  accident  occurrence. 


(On  the  following  pages,  four  representative  responses 


are  included. 


) 


V 
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Aircraft  type  flHA  n.M  M.  ^ 

ApprOKl.  ..su’ir  r«p  ,tHk. - .  klrd  LnJTng—  infU,Kr^t. 

sUiwff-JSggrjagsa  .,,,,;5nr _ • . 

Jijot  experience:  nigh  ,  average  .  low 

JJ r‘ct"t  iCt  unproTuTent  — — ' 

Z—*  L*°  TaTiro"  .TIFri'cade 

wp.  blgfr^jjrt  very  Tow  ,  crosswind -  - ' 

Extremely  reduced  cell Ing/vIsIbiTTlT'  no  horTion* 

Aircraft  malfunction/emergency  Alo&Z — *  — - * 

Extreme  pressure  on  ISO  to  get  aTjffiatt  aboard  fJo  T - * 

Narrative: 

Aj(6ifT  6.Q  M*>  ,  f'tf  exPeUgtioeP  Avi*ro«- 

e*>  INITIAL  I K-'i<4  CAVLAiMV,  picrfr  Rf^eCp  Pb^**- 

<*  i* if  w*ic*  6fnowc*i  iP-  ci*>€T  *> 

||C  $**>  64U.  ftt/lPi/  .  bed*.  U*0 

J#  Ca*\VuO  kTD  M«fH  orfunc  fW^tP  .  3Ave 

i 

1^9  AMvKVcy  ^oA-»C  ff^  ^ ^  6dAJf<eu^^c 

KIT  */AV£  -  6  hf~  C41VS  ,  AA-»°  Ale  A 

^  Above  AvrtAee  MaifC  AS  7?tflF  DiOv’T 

AuuvJ  CAv l*  ,  PADDurS  n>**Ai3> 

Me  AT  \u+*k  9\(>x*  uo lO.  PlPfT  HVID  ?(Ufg- ft 

ATflTVpf  wiAicVA  AriPli  AJArYVp  tkWMrC  ?S«e  /AJ-Fci*  4l~ . 

tU-AlMiMCr  efSS***  p*PtC4»rwvy  J*r^ — 

Ale  . 


'■.•'■.•V'jiV' •  ■  • . ■• . 
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Aircraft  type  K  ~T  _ .  Day  _ or 

Approach  results:  ramp  strike  ,  hard  landing  , 

ment  ,  off-center  engagement  _ ,  waveoff 

successful  atcfiilfliftat  or  barricade  S  . 

Pilot  experience:  high  ,  average  ,  low  _ 

Pilot  proficiency:  recent  /  .  unproficient  . 

Pilot  skill  level:  average _ ,  above  ^  .  below 

Pitching  deck  _ ,  MOVLAS  _ «  LSO  Talkdown 

WOD:  very  high  ,  very  low  ,  crosswind 

Extremely  reduced  cei llng/vlsibl lity  ,  no  horizon 

Aircraft  malfunction/emergency  / _ 

Extreme  pressure  on  LSO  to  get  aircraft  aboard 

Narrative: 


or  Night 

,  Inflight  engage- 
7  _ ,  bolter 


larricade 


t’lUT  kn&'nvrgo  *4.  cog  i  ArPpc’c^cA  — 

? usi-feu eiZ-  uwnL 

UJ  L-so  Qteezogh  kcus  otueeu?u? 

LiC-ii-fT  AiUb  b  Pits5r_ 

4t-  &<3ak0  TO  -SgrT^  g.APibi.'f  4^ 

Ctsme*  Zmv  6^  3-4-  fesr.  Vn*r 

(WCu33  F(2S^  £XJ  J/-fF  iiuft ’bv&r&uTl'^ 

Mtrr  -sgstj  4ets  ^tJcet/pLE. 

i 

?|<^3T  «  Lou.et>  ioa>  ccm?LA.ce1otK\ 

S\|  \jez\^  «A<3t>e  x 

10  b&GP  lgcjC. 
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Aircraft  type  _ _ F_-  4  _  ,  Day  or  Nioht 

Approach  results:  ramp  strike  .  Tiard  landing  inflight  engage - 

■«nt _ .  off-center  engagement  35'rr  waveo?T  ,  bolter 

successful  arrestment  or  barricade  .  -  - * 

Pilot  experience:  high _ ,  average  T  low  . 

Pilot  proficiency:  recent  ✓  ,  unproficient _ . 

Pilot  skill  level:  average  ,  above  ,~BFIow 

Pitching  deck  _ ,  NOVLAS _ .  LSO  TaTFSown  .^.“Barricade 

U00:  very  higH  ,  very  low  ,  crosswind _ . 

Extremely  reduced  cei  ling/vl Sibil ity  no  horizon 

Aircraft  malfunction/emergency 

Extreme  pressure  on  LSO  to  get  aircraft  aboard  »✓*""; - * 

Narrative.  ^rrHfce  i  wa<  *400  oO  u&o  Amp 

c  vr  a,  about  >/r  .  cc.uug 

200FT-  vve-  uAMtafer*  fvv^.  ■J3'-/  TncJo w e>  'W6sM  up  a>j^ 

tauomo  *th&  iwc/^eur  ^.4  Flcu»4  xlu<s<3err 

•viL^rr  lAjrrw.  ■ae.ucvo  Aves-Acs^  A^tury.  vje.  pi him  up  A  UTTLfi 

MtetJ  Am£  &  l£-T=T  Amb  Hfc  uu\3  T?\_b  “Tp  CC>Mt  M~r. 

1  r-i &  “THCr  Ct»rnieu  He.  -td'-N  -to  -sr^e-r-  TT  Sikx 
— fHfc  tgpT  Wt-E-M  “fHfe  ^ l tear  4>D  HC’T  Ci  /  ^  5T/2z>au«» 

‘’LJE.-^r  uKtUP"  VU45-  IVSU&A  A*^  ~TM£M  *L£f*T“ 

UEJsrr  gu&D&C..",  "ThSe:  A'PPcAn1£  kVA^  “T^E;  VUSv^  -  crp-p- 

*Pfc>iKTT  AMP  CZosSf-A  THt  fe4WP  U?vV(  PT-AT^  L\vi&C>  \M»  C-iO-l-Tr 
AmO  1  <  »JO.  Psht.  TV-iSs.  -Piccrr  oc?«gJg^crr>«-  rs  "BAcjc  “!fc>  "THt 

\Sf rr  AT  fHC-  LAST"  )U  «rrA#4T,  AMP  PiCJCfcA  OP  -TH^  4  wik£ 

-TWf  £Ty  •  Pr,vfc  (^)  1ZJ<3H-rr  "THe  A»ePLAM€,  SuJeevfcb  Am  ip 

O^T  roCTvMATCAy  -rr^o  w>»«-fc  Am  b-pHt  TA  ufcco 

fffcx  b  HAb  THfV  “THO  feucn  VODUU&  MAvttu 

CAtATT^^PHI  >c, 

L&5^c?urs  ^  -nnei_Y  u>Avfc-c>r=F  wAj  oBvicrcncy 

-THfc  CJG.M-r  CCTve-sB  OP  AcT>ptJ/  -rierr  /u0o 

-jeutviut  -FMAr  ^  CC7^Ub  TAuiC  AM'/fcoO/  p,^ 

plD  Kerr  -TP  CAU_S  Akia  ^Ar>  a  >Hc><t£E>Jt>OC3 

|M&  T'HGt  ®-AMp.  v£\_>  CAu^r  AMP 

A  W^VtPFF  13  TSOM&TVi '  KO  ^fe-  £M^okS-H  Al'5d< 

THfe  VLtAr-M^f^  iVAn  BEt-CVO  MIMIUUU?.  L5o^  /»J  TO  &XJ-3U^ 

"That  th4  beo  3ictvJ  -  ►'Aw^ee.s  Aee  A^v’A  te  of 

MAt&i  CcUOiTiyu^. 
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Aircraft  type  p  Wfe 


Aircraft  type  b  >15  _ ,  Day  or 

Approach  results:  ramp  strike  ,  hard  landing  '  , 

_ ,  off-center  engagement  ,  waveoTT 

successful  arrestment  or  barricade  ^ 

Pilot  experience:  high  ,  average  — T  low 

Pilot  proficiency:  recent  ✓*,  unproficTent  — T 

Pilot  skill  level:  average  ~7  ,  above  .  below 

Pitching  deck  _ ,  MOVLAS  ~L%  LSO  TaTEHown 

WOO:  very  hi gh ~  ,  very  low  ,  crosswind 

Extremely  reduced  cei ling/vi sibi lity  ,  no  horizon 
Aircraft  malfunction/emergency  ”  " 

Extreme  pressure  on  LSO  to  get  aircraft  aboard  ✓~T~ 

Narrati ve: 


or  Night 

,  inflight  engage- 
T  .  bolte? 


barricade 

./  . 


OftJ  P-^  a/UAtPy  or)  a.  Z.  P-  ]$tl 

4^F4  Lj&q  (foo aj@P jtf-L  t  LS O 

IfcP&cP Im  (j$£U>  ZoL?  J  V*4U  /y/<L 

p-  CM cL  aTPZPS f  2 ' hfoLiT 

/*d*p  —  C&u£a>  *  /UL^iyo  (7^4  c/aj:  n  Lfcct ) 

A/c  OJ&o  bio  a£t  4^  f  Scrrrzkrr^  G&uj-m 

£  S*F>C  uP&fi  <b)  /Jeez  loi  c  fr6u)rj  aoaS-  t-± 

£p-nYvr^t4*JF\  jjsj  pc^P ct '  fcP&cJpbfp, 

ohJ^iij  -  ftficvc  \ dJb&iJT by 

/frsu.  a/c. 
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Please  t>e  ISO  shorthand  symbology,  with  additional  narrative  as  re¬ 
quired,  to  describe  five  or  more  typical  approach  profiles  which  can 
lead  to  unsuccessful  approaches.  Also  note  the  different  types  of 
results  (ramp  strike,  hard  landing,  bolter.  Inflight,  etc.)  which  can 
result  from  each  profile.  For  example:  HFX  CDAW,  ramp  strike  or  hard 
landing;  OC  (LOSLO)IC  /CV,  bolter;  SIC-AR  PNU  on  WO,  Inflight  engagement. 


Ramp  Strike/Hard  landing: 

LOX  HIM- IC  CDAR 
HX-1C  CDAR 
OC  CIC/HIC  CDAR 
NEPAW  SAR 
SAR  on  LLU 

EG/DN  correcting  for  LOIC 


Off-Center  Engagement: 

LURX/IM  R-LAW 
LUIX/IM  L-RAW 
OCLULIC  L-RAR 
OCLURIC  R-IAR 
DRRIC/AR 
DRL1C/AR 


Bolter: 

OCLOIC/SIC  ^ 
OCCO 

TMP  on  LLUIC 


In-flight  Engagement: 

CDIC-AR  PNU  0C0 
CDIC-AR  TO  on  WO 
OCCDAR  PND“ 
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For  each  aircraft  listed  below,  please  describe  specific  characteristics 
or  performance  limitations  which  can  affect  the  ISO  when  waving  a  night 
approach.  Also  mention  malfunctions  or  emergencies  of  particular  concern 
to  the  ISO. 

A6:  Excellent  power 

Settles  on  late  lineup 
Hook-skip  bolters  on  ND 
KA6  underpowered 

single  engine-only  problem  high  G.W.,  high  temp.,  high  winds 
Lineup  difficulties 

EA6:  Excellent  power 

Long  fuselage  and  sensitive  nose  -  in-flight  potential 

Hook-skip  bolters  on  ND 

Decel  tendency  due  to  sensitive  nose 

A?:  slow  engine  (fan)  response 

HIM  SIC-AR  and  LOX-IM  to  Bolter  are  common 
AOA  and  lights  fail  frequently 


E2:  Excellent  power 

Lineup  difficult  and  critical 
Hook-skip  bolters  on  ND 

No-flan  approach-cocked  up,  reduced  H/R  clearance 
Glideslope  sensitive  to  nose 

F4:  Excellent  power,  easy  to  over-control 

High  WOD  requirements  due  to  high  approach  speed 
Fuel  critical 

Single  engine  --  poor  response,  high  speed  (H  flaps) 
HIC  CDAR  common 

Slow  engine  (fan)  response 
Long  fuselage  --  in-flight  potential 
Hook-skip  bolters  on  ND  and  late  lineup 
Lineup  critical 


F/A18:  Excellent  power 

Flat  attitude  on  AOA 

Nose  and  power  adjustments  must  be  coordinated 
Easy  to  overrotate  on  WO 

Slow  engine  (fan)  response 
Tendency  to  "glide" 

DLC  good  for  high  deviation 
Difficulties  with  burble 


R2 
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In  the  space  below,  describe  two  or  more  of  the  most  difficult  night 
waving  situations  you  can  Imagine.  Note  the  primary  reasons  for  dif¬ 
ficulty  and  your  estimate  of  the  probability  such  a  situation  would  ever 
occur. 


Frequently  mentioned  situations: 

pitching  deck,  no  horizon,  MOVLAS 

pitching  deck,  no  horizon,  MOVLAS,  "Blue  Water" 

Frequently  mentioned  variables : 
pitching  deck 
no  horizon 
MOVLAS 
"Blue  Water" 
rain/low  visibility 
low  fuel  state 


Primary  reason  for  difficulty: 

•  LSO  waving  overload  (perception,  pressure,  complexity) 


Additional  comments.  Including  any  criticisms  of  this  questionnaire 
and  suggestions  for  improvement: 
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APPENDIX  C 

COST  SAVINGS  ESTIMATION  MATERIALS  AND  DATA 


RESEARCH  FOR  LSO  TRAINING: 
CARRIER  LANDING  ACCIDENT  SEMINAR 


NAVTRAEQUIPCEN  80-C-0063-2 

THEL  HOOKS  ("RETIRED"  LSO)  -  MATHETICS,  INC. 

RESEARCH  FOR  LSO  TRAINING: 

NTEC /HUMAN  FACTORS  LAB 
LSO  TRAINING  MODEL  MANAGER 

POTENTIAL  PAYOFFS  FROM  IMPROVED  TRAINING: 

MORE  WING  QUAL  LSOs 

REDUCED  LSO  WORKLOAD  -  JOB /TEACHING 
BETTER  PREP  FOR  CRITICAL  SITUATIONS 

POTENTIAL  IMPROVEMENT  AREAS: 

GUIDANCE/MATERIALS  FOR  LSO  TRAINING 

-  INFORMATION  ABOUT  TASKS/RESPONSIBILITIES 

-  EMPHASIS  ON  MORE  CRITICAL  ASPECTS  OF  WAVING 

SIMULATED  WAVING  ENVIRONMENT 

-  EARLY  EYE-MOUTH  COORDINATION 

-  PICKLE  TIME 

-  CONTROLLED  EXPOSURE  TO  CRITICAL  SKILLS/SITUATIONS 

INPUTS  DESIRED  FROM  LSO  COMMUNITY 

-  CRITICAL  SKILLS/WAVINC  CONDITIONS  FOR  TRAINING 

-  TRAINING  EMPHASIS  PRIORITIES 
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TODAY'S  SEMINAR  —  REVIEW  AND  DISCUSS  MISHAPS: 

MISHAP  PREVENTION 

LSO  SKILL  IMPROVEMENT  THROUGH  TRAINING 

MISHAP  SAMPLE: 

158  JULY  '70  -  DEC  '79 
LSO  CITED  IN  51 
22  TO  BE  REVIEWED 

CONDUCT  OF  SESSION: 

REVIEW  MISHAP  SUMMARY 
HIGHLIGHT  KEY  ELEMENTS 

JUDGE  POSSIBILITY  THAT  LSO  COULD  HAVE  PREVENTED 
THE  MISHAP 

JUDGE  POSSIBILITY  THAT  LSO  COULD  HAVE  BEEN  TRAINED 
TO  BETTER  HANDLE  SITUATION 

IDENTIFY  IMPORTANT  TRAININC  IMPLICATIONS 

SESSION  CONSTRAINTS  -  INFO  AVAILABLE,  TIME 

OPEN  DISCUSSION  FOLLOWING  REVIEW  OF  ALL  MISHAPS 
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MISHAP  PREVENTION 

•POSSIBILITY  THAT  LSO  (CONTROLLING  OR  BACKUP)  COULD  HAVE 
PREVENTED  MISHAP* 


•  .2  .«  .6  .8  1.0 


DEFINITELY  DEFINITELY 

NO  CHANCE  SHOULD  HAVE 

HIGH  RATING  FOR  HICH  LEVEL  OF  RESPONSIBILITY: 

— LANDING  AIRCRAFT  ON  FOUL  DECK 
--OBVIOUSLY  AFU  APPROACH  WITHOUT  WAVEOFF 
—LINEUP  SCAN  BREAKDOWN  BY  LSO(s) 

—ETC. 

MODERATE  RATING  FOR  AVAILABILITY  OF  CLUES  SUGGESTING  THAT 
WAVEOFF  OR  OTHER  ACTION  MIGHT  BE  PRUDENT: 

—POOR  CONDITIONS,  UNSTABLE  APPROACH 

—BAD  START/OTHER  INDICATIONS  OF  PILOT  BEHIND  AIRCRAFT 

—■CLASSIC"  APPROACH  TRENDS 

—ETC. 

LOW  RATING  FOR  CIRCUMSTANCES  WELL  OUTSIDE  LSO  CONTROL 
—ACCEPTABLE  APPROACH,  PILOT  DN /EC /DR  WELL  INSIDE 
WAVEOFF  WINDOW 
—ETC. 
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LSO  TRAINING 

"POSSIBILITY  THAT  IMPROVED  TRAINING  AND/OR  ADDITIONAL 
EXPERIENCE  COULD  HAVE  HELPED  THE  LSO(s)  TO  BETTER  HANDLE 


SITUATION" 

•  .2 

.«  .6 

.»  1.0 

X' ■>//'.  '  4 

V77777?* 

definiAly 

DEFINITE 

HO  HELP 

HELP 

HIGH  RATING  IF  ANY  OF  THE  FOLLOWING  WOULD  HAVE  HAD 
STRONG  POSITIVE  INFLUENCE  ON  LSO(«)  PERFORMANCE  IN  MISHAP 
SITUATION: 

—MORE  OVERALL  WAVING  EXPERIENCE  (PICKLE  TIME) 

—PRIOR  EXPERIENCE  WITH  THIS  OR  SIMILAR  SITUATIONS 
—MORE  EXTENSIVE  TRAINING  EMPHASIS  ON  DECISION  FACTORS/ 
WAVING  CONDITIONS  ASSOCIATED  WITH  THIS  MISHAP  SITUATION 

MODERATE  RATING  IF  THE  ITEMS  ABOVE  WOULD  HAVE  HAD  SOME 
POSITIVE  INFLUENCE  ON  LSO(»)  PERFORMANCE  - 

LOW  RATING  IF  THE  ITEMS  ABOVE  WOULD  HAVE  HAD  LITTLE  OR 
NO  POSITIVE  INFLUENCE  ON  LSO(t)  PERFORMANCE 
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IMPORTANT  TRAINING  IMPLICATIONS 

ASPECTS  OF  THIS  MISHAP  SITUATION  WHICH  WOULD  BE  PARTICULARLY 
IMPORTANT  IN  PREPARING  AN  LSO  POR  THIS  OR  A  SIMILAR  SITUATION 

_ WAVEOFF  DECISION 

_ RECOGNIZING  APPROACH  DEVIATIONS 

_ USE  OF  TIMELY  AND  CORRECT  LSO  CALLS /SIGNALS 

_ USE  OF  AND/OR  DECISION  TO  USE  MOVLAS 

_ LSO  SCAN 

LSO  KNOWLEDGE  (PROCEDURES,  OPERATING  RULES/ 

LIMITS,  AIRCRAFT  CHARACTERISTICS  /LIMITATIONS,  ETC. ) 

_ LSO  PLATFORM  "TEAM"  INTERACTION  /COORDINATION 

_ BARRICADE  RECOVERY 

_ "CLASSIC"  APPROACH  TREND 

_ RECOVERY  COORDINATION  (CATCC/PRI  FLY /LSO) 

_ DECK  MOTION 

_ NIGHT  ENVIRONMENT 

_ NON-OPTIMUM  WOD 

_ NO  HORIZON 

_ LOW  PILOT  EXPERIENCE  LEVEL 

POOR  PILOT  RESPONSIVENESS  TO  LSO 

_ ABNORMAL  AIRCRAFT  CONFIGURATION 

_ BOARDING  PRESSURE 

_ DECK  STATUS  (CLEAR/FOUL) 

_ AIRCRAFT  MALFUNCTIONS 

OTHER:  _  _ 
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APPENDIX  D 
KEY  CONCEPTS 

This  appendix  presents  an  extensive  listing  of  key  concepts  to  be 
acquired  by  an  ISO  trainee.  They  describe  many  of  the  Interrelationships 
among  situation  cues,  decision  factors  and  LSO  actions.  This  listing  cannot 
be  considered  exhaustive  but  should  provide  direction  in  the  continuing 
definition  of  LSO  training  requirements.  Categories  Into  which  the  key 
concepts  have  been  grouped  Include: 

Basic 

Pilot 

Profile 

Aircraft 

Malfunction 

Environment 

Operational  Situation 


BASIC 

As  a  general  voice  call  strategy.  Informative  calls  are  used  early  in 
an  approach  and  Imperative  calls  are  used  late  In  the  approach. 

A  calm  and  confident  sounding  "Roger  Ball"  (or  "Paddles  Contact")  is 
critical  to  pilot  confidence  In  LSO.  An  excitable  or  unconfident 
sounding  call  may  have  a  negative  effect  on  subsequent  pilot 
responsiveness. 

LSO  can  become  perceptual ly  "deceived"  by  a  smooth  approach  with  a 
minor  deviation  (such  as  little  high).  This  can  negatively  affect 
critical  perceptions  In  close  and  can  also  hurt  LSO  credibility  during 
debrief.  This  deception  can  also  be  brought  on  by  a  series  of  smooth 
approaches  with  some  deviation.  Over  a  period  of  time,  pilots  will  try 
to  fly  the  type  of  approach  that  they  think  the  LSO  wants  to  see  for 
an  OK  grade. 

LSO  scan  breakdown  (GS,  LU,  AOA  cues)  can  lead  to  drastic  deviation  in 
one  dimension.  A  common  LSO  (and  pilot)  mistake  is  excess  attention 
to  GS  at  the  expense  of  LU.  Thus  the  B/U  LSO  must  also  be  actively 
Involved  in  the  pass  and  alert  to  breakdown  of  controlling  LSO  scan. 

Always  use  waveoff  call  and  pickle  simultaneously  when  waveoff  is 
required. 

LSO  (or  B/U,  or  other  team  member)  must  always  check  roll  angle,  hook- 
to-ramp,  hook-to-eye  and  wind  before  each  pass. 
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Inside  the  normal  waveoff  point,  use  waveoff  any  time  deck  goes  foul 
and  any  time  100%  power  Is  needed  for  aircraft  to  clear  ramp  (however, 
the  latter  may  be  controversial). 

At  least  one  ISO  must  always  be  monitoring  the  radio  during  a 
recovery. 

LSO  has  dual  waving  responsibilities  (responsible  for  safe  and 
expeditious  recovery).  The  safety  aspect  must  never  be  compromised"! 

LSO  must  be  alert  for  a  settle  on  lineup  correction.  A  "Dower"  call 
prior  to  the  lineup  call  should  be  considered  when  aircraft  Is  approa¬ 
ching  in  close. 

Do  not  accept  an  aircraft  without  an  approach  light  or  with  a  flashing 
approach  light.  If  possible,  ask  pilot  to  check  gear  or  hook  (as 
appropriate)  well  prior  to  ball  call. 

Oo  not  secure  from  the  LSO  platform  with  the  lens  still  on. 

Do  not  let  the  lens  be  turned  on  until  assured  you  have  the  capability 
to  communicate  and  to  use  the  pickle. 

Try  to  wave  such  that  the  pilot  makes  his  own  corrections.  When  his 
performance  or  recovery  conditions  start  deteriorating,  you  must 
increase  your  Involvement  in  the  pass. 

The  waveoff  call  must  be  given  firmly  but  calmly.  An  over-excited  call 
may  lead  to  excessive  pitch  response  from  the  pilot  and  an  inflight 
engagement. 

Insure  pilots  are  informed  when  MOVIAS  is  In  use. 

MOVLAS  must  be  moved  enough  to  enable  pilot  discrimination  of  ball 
movement . 

More  LSO  calls  than  usual  should  be  made  when  MOVLAS  Is  in  use  with 
pitching  deck  conditions. 

The  LSO  must  avoid  the  tendency  for  a  "high  eye"  when  using  MOVLAS. 

When  working  MOVLAS,  do  not  delay  the  waveoff  decision.  Remember  that 
you  are  busier  than  usual. 

The  B/U  LSO  should  never  assume  that  the  controlling  LSO  will  keep 
aircraft  off  the  ramp  or  that  the  controlling  LSO  has  a  handle  on  a 
lineup  deviation.  Be  prepared  (as  B/U  LSO)  to  give  waveoff. 

As  controlling  LSO,  do  not  become  too  dependent  on  aircraft  control 
Inputs  from  B/U  LSO. 
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A  fatigued  or  medically  grounded  LSO  should  not  be  waving  or  backing 
up. 


r: 

If  LSO  notes  slow  pilot  responsiveness  approaching  in  close,  use 
waveoff  earlier  for  critical  deviations. 

LSO  should  consider  very  inexperienced  pilot  as  especially  unpredict¬ 
able,  however,  LSO  should  not  "lower  his  guard"  for  highly  skilled  or 
experienced  pilots.  They  will  occasionally  make  critical,  unpredict¬ 
able  errors  requiring  waveoffs. 

LSO  should  never  assume  that  a  pilot  can  salvage  an  approach  without 
LSO  help. 

LSO  should  never  assume  that  pilot  will  make  proper  correction  for  a 
given  deviation. 

For  a  disoriented  pilot  (i.e.  vertigo)  or  one  suffering  from  fatigue, 
LSO  may  have  to  "climb  into  cockpit"  (i.e.  LSO  talkdown)  to  effect  a 
safe  recovery  (however,  do  not  stay  there  if  you  do  not  have  to). 

LSO  should  never  assume  that  the  pilot  will  make  correct  response  to 
LSO  call  in  close.  Be  prepared  to  follow  up  the  call  with  waveoff. 

The  quality  level  of  a  pilot’s  past  performance  (FCLP  or  CV  ops)  is  no 
guarantee  of  the  same  on  any  given  approach. 

Any  malfunction  which  causes  a  change  in  the  normal  pilot  habit  pat¬ 
terns  can  degrade  the  visual  portion  of  the  approach  (i.e.  no  TACAN, 
no  needles,  no  gyro). 

Low  proficiency  In  pilots  tends  to  be  evidenced  by  poor  starts  and 
overcontroll ing  everything  all  the  way. 

The  pilot  who  experiences  more  than  2  passes  (possibly  excluding  foul 
deck  waveoffs)  to  get  aboard  has  a  higher  probability  of  making 
radical  corrections  in-close  to  in-the-wlres. 

For  CQ-type  "endurexes",  the  last  pass  has  a  good  probability  of 
exhibiting  some  type  of  "get-aboard-ltls". 

Early  wires  over  a  period  of  time  by  the  same  pilot  is  indicative  of 
"deck-spotting". 

Ouring  CQ,  pilot  scan  is  usuallyslow,  therefore,  be  extremely  cautious 
of  multiple  deviations  in-the-middle  to  in-close. 
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LSO  should  consider  moving  waveoff  point  out  slightly  for  a  pilot 
known  to  be  unproficient. 

Waveoff  point  should  be  moved  out  for  a  disoriented  or  unresponsive 
pilot. 

After  about  2  or  3  power  calls  without  sufficient  pilot  response,  the 
waveoff  should  be  used. 

If  one  attitude  call  does  not  get  sufficient  pilot  response,  switch  to 
a  power  call  (or  waveoff,  if  needed). 


PROFILE: 


More  ramp  strikes  occur  when  pilot  Is  correcting  for  a  high  deviation 
in  close  than  for  a  low  deviation. 

For  significant  multiple  deviations  in  close,  a  waveoff  should  be 
used  by  the  LSO.  As  a  rule  of  thumb.  If  2  major  deviations  (from  among 
GS,  LU,  AOA  or  power)  are  AFU  approaching  the  waveoff  point,  use 
waveoff.  This  is  especially  critical .with  CQ  pilot. 

For  unsettled  dynamics  (speed,  power,  wing  position,  flight  vector, 
pitch)  in  close,  LSO  should  consider  giving  a  waveoff. 

High  at  the  ramp  with  less  than  optimum  rate  of  descent  can  lead  to  a 
dangerous  long  bolter.  Do  not  hesitate  to  use  waveoff. 

High  at  the  ramp  with  excessive  rate  of  descent  can  easily  result  in  a 
hard  landing. 

LSO  should  never  accept  a  low  trend  on  an  aDproach. 

Be  prepared  for  sink  rate  Increases  during  late  lineup  corrections. 

LSO  should  not  accept  a  high  trend  on  an  approach. 

Poor  trends  leading  to  the  start  and  at  the  start  are  good  indicators 
that  the  pass  Is  going  to  be  a  problem  due  to  pilot  disorientation  or 
poor  pilot  scan. 

A  poor  start  frequently  leads  to  overcontrol  tendencies  in  the 
remainder  of  the  pass. 

Be  alert  for  the  "moth  effect"  (drift  left  in  close  or  at  the  ramp) 
due  to  pilot  fixation  on  the  meatball  at  the  expense  of  lineup 
control . 
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During  day  recoveries,  beware  of  pilot  tendency  to  try  to  salvaqe  an 
extremely  poor  start  (i.e.  OSX,  NESA  HFX,  HFX,  etc.)*  If  not  stable 
approaching  in  close  position,  use  waveoff. 

A  major  glldeslope  deviation  at  the  start  to  in  the  middle  Is  diffi¬ 
cult  for  the  pilot  to  salvage.  Extra  LSO  assistance  may  be  needed  to 
help  pilot  get  aboard. 


AIRCRAFT: 

If  calls  are  necessary  for  aircraft  with  slow  engine  response  (A-7,  S- 
3,  F-14),  they  must  be  given  well  prior  to  glideslope  interception 
when  correction  is  being  made  for  a  high  deviation. 

For  aircraft  with  excellent  engine  response  (A-6,  EA-6,  F-4),  be  alert 
for  pilot  overcontrol  of  power.  This  also  includes  excessive  power 
reductions  following  too  much  power. 

For  aircraft  which  have  difficult  APCS  disengagement,  waveoff  point 
should  be  moved  out  slightly. 

Lineup  control  for  "slow  movers"  (i,e.,  S-3,  E-2)  is  more  critical  in 
shifting  wind  conditions  than  for  "fast  movers." 

APCS  should  not  be  used  in  high  wind  conditions  (greater  than  35 
knots). 

Large  wingspan  aircraft  (i.e.,  E-2,  S-3,F-14,  etc.)  must  be  on  lineup 
and  have  little  or  no  drift  by  the  in  close  position. 

For  A-7  and  F-14,  HFIM-IC  trend  is  potentially  disastrous  due  to  DEC 
CD  potential. 

For  A-7,  do  not  allow  HCDIC  trend.  Excess  sink  rate  is  difficult  to 
stop  with  power  due  to  poor  engine  response. 

For  A-6,  beware  of  settle  on  lineup  correction  when  aircraft  is 
LOSLOIC. 

For  F-4,  do  not  allow  significant  nose  movement  and/or  power  reduc¬ 
tion,  especially  for  HIC  deviation.  An  extremely  high  sink  rate  can 
result. 

For  F-14,  in  a  HNDIC  situation  with  APCS,  excessive  sink  rate  will 
result.  Attitude  correction  will  not  be  adequate,  therefore  use  power 
call (s) . 


EA-6B,  E-2  and  F-14  have  long  fuselages,  therefore  potential  for 
inflight  engagement. 
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For  A-7,  a  LOB  pass  requires  critical  nose  finesse  to  avoid  bolter  or 
ramp  strike. 

For  F-4  and  A-7,  due  to  normally  high  approach  speed,  must  pay  close 
attention  to  closure  under  light  WOD  conditions. 

For  EA-6B,  glldeslope  control  is  very  sensitive  to  nose  movement.  This 
sensitivity  can  also  lead  to  a  decel. 

For  S-3,  aircraft  glideslope  control  through  the  "burble"  is  difficult 
under  high  WOO  conditions. 

For  S-3  and  F-14,  beware  of  a  drop  nose  in  conjunction  with  DLC 
activation  in  close.  Excessive  sink  rate  will  result. 

Lineup  corrections  are  difficult  with  F-4S  due  to  reduced  lateral 
control  effectiveness. 

For  S-3,  use  of  DLC  Is  good  for  high  deviations  and  avoiding  large 
power  reductions  except  when  approaching  "at  the  ramp"  area. 

F-4  and  EA-3B  are  very  fuel  critical  vdue  to  max  trap  fuel  limitations 


MALFUNCTION: 

With  less  than  optimum  lighting  configuration,  LSO  range  discrimina¬ 
tion  is  degraded,  thus  causing  difficulty  in  determining  a  safe 
waveoff  point  (for  both  technique  and  foul  deck  waveoffs). 

For  a  NORDO  aircraft,  move  waveoff  window  out. 

For  a  NORDO  aircraft,  always  use  voice  calls  and  emergency  UHF 
override  anyway,  in  addition  to  light  signals. 

Remain  alert  for  malfunction  during  ACLS  Mode  I  approach.  Smooth 
trends  early  in  approach  are  no  assurance  of  successful  termination. 

For  single  engine  approach,  do  not  accept  a  poor  start. 

For  an  aircraft  with  only  a  single  light  visible,  consider  having  the 
NFO  use  his  flashlight  as  an  extra  reference.  Also  consider  having 
CATCC  or  B/U  LSO  provide  range  calls. 

Whenever  time  permits,  obtain  briefing  on  aircraft  malfunction.  Try  to 
avoid  relying  on  memory. 

Be  aware  of  possible  configuration  and/or  speed  differences  for  an 
aircraft  with  a  malfunction. 


* 
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For  a  malfunction  situation  with  abnormal  configuration,  always  ask 
the  pilot  what  his  approach  speed  will  be  (in  IAS). 


For  A-6,  flaps  can  creep  up  with  hydraulic  failure. 

For  abnormal  configuration  approaches  always  check  to  see  if  a  roll 
angle  change  Is  needed. 

For  S-3,  no  flap  approach  waveoff  point  must  be  moved  out  signifi¬ 
cantly. 

For  F-14,  pilot  has  to  work  very  hard  for  a  successful  single  engine 
approach. 

For  S-3  and  E-2,  single  enqine  approach  lineup  control  is  difficult 
due  to  asymmetric  thrust. 

For  E-2  on  single  engine  approach,  decel  must  be  avoided. 

On  single  engine  approach,  F-4  Is  underpowered  and  needs  afterburner 
on  waveoff  and  bolter. 

For  a  sinqle  engine  landing,  the  C-l  is  faster  and  should  not  flare 
for  landing. 

For  F-4,  with  loss  of  BLC  or  half-flap  configuration,  approach  speed 
is  very  high.  Therefore  WOD  requirements  are  critical. 

For  E-2,  lineup  is  extremely  critical  (+^2-1/2  feet)  for  a  barricade 
recovery. 

For  S-3,  without  DLC,  nose  pitch  Is  very  sensitive  to  power  changes. 

For  F-14,  without  DLC  engaged,  aircraft  is  farther  back  on  power  than 
normal,  thus  resulting  in  reduced  engine  responsiveness. 


ENVIRONMENT: 

With  pitching  deck  conditions,  be  very  hesitant  to  accept  a  high 
deviation  in  close. 

For  reduced  visibility  situation  with  a  late  breakout  (inside  3/4 
mile),  ISO  must  track  aircraft  positioning  and  trends  with  whatever 
means  are  available  (SPN-42,  ISO  HUD,  listen  to  CCA  calls,  etc.)  so 
that  there  are  no  surprises  and  the  ISO  is  prepared  to  give  timely  aid 
to  the  pilot  (or  make  a  timely  waveoff  decision). 
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With  a  high  WOO  situation  (35  knots  or  more)  aircraft  dynamics  can 
rapidly  deteriorate  to  a  settle  in  close  with  only  slight  power  or 
aircraft  attitude  changes.  Also  APCS  should  not  be  used  in  this 
situation. 

With  a  low  WOO  situation  (less  than  25  knots),  the  high  closure  rate 
does  not  allow  much  margin  for  salvaging  a  come  down  or  settle  In¬ 
close,  therefore,  move  waveoff  window  out. 

Starboard  crosswind  causes  Increased  sink  rates  at  the  ramp. 

Crosswind  conditions  can  cause  rapid  drift  rates  in  close  and  at  the 
ramp. 

During  crosswind  conditions  be  prepared  for  increased  sink  rates  with 
late  lineup  corrections. 

When  there  is  no  horizon  and  deck  is  moving,  have  plane  guard 
destroyer  or  helo  positioned  aft  of  the  ship  near  final  bearing  to  aid 
glideslope  reference. 

When  deck  is  moving,  move  waveoff  window  out. 

LSO  talkdown  may  be  required  when  pilot  visibility  is  reduced  by  sun/ 
moon  glare,  smoke  in  the  groove,  rain,  canopy  fog,  etc.  If  pilot  can 
not  see  by  1/4  -  1/2  mile,  he  should  waveoff  or  be  waved  off. 

LSO  (or  B/U)  must  .continually  check  closure  speed  to  insure  adherence 
to  max  engaging  speeds,  especially  under  low  WOD  conditions. 

With  no  visible  horizon  use  dynamic  hook-to-ramp  indicator  to  help 
predict  deck  pitch  cycle;  however,  remember  that  there  is  some  lag  in 
the  indication. 

When  deck  is  moving,  LSO  must  make  more  voice  calls  than  usual. 

With  no  horizon  reference  available,  use  other  means  (HUD,  SPN-42)  to 
insure  proper  eyeball  calibration. 

LSO  should  inform  pilot  of  abnormal  WOD  conditions. 

For  WOD  greater  than  35  knots,  a  4.0  degree  basic  angle  should  be  used 
When  basic  angle  is  changed,  CATCC  must  be  informed. 

As  a  rule  of  thumb,  if  50%  or  more  of  the  passes  are  indicative  that 
pilots  are  "chasing  the  ball",  MOVLAS  should  be  rigged.  If  stabiliza¬ 
tion  appears  good,  stick  with  lens. 

When  aircraft  is  lined  up  left  in  close,  it  is  easy  for  the 
controlling  LSO  to  lose  track  of  deck  motion  cycle. 
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Under  reduced  visibility  conditions,  the  pilot  has  more  difficulty 
seeing  visual  landing  aids  than  LSO  does  seeing  aircraft.  Be  prepared 
to  provide  extra  assistance. 

When  deck  is  moving,  be  alert  for  "dutch-roll-  which  affects  lineup  as 
well  as  glideslope. 

When  the  wind  is  30-35  knots  and  aircraft  are  landing  short, 
consideration  should  be  given  to  targeting  the  number  4  wire. 


OPERATIONAL  SITUATION: 

Do  not  let  low  fuel  state  situation  or  any  other  boarding  pressure 
cause  you  to  lessen  the  safety  margin  for  an  approach. 

Never  press  the  waveoff  decision  point,  no  matter  what  boarding 
pressure  exists. 

For  a  situation  requiring  increased  need  for  a  trap,  give  extra  aid  to 
pilot  earlier  than  usual  in  an  approach.  Work  to  get  aircraft  In  a 
"workable"  position  in  close  (i.e.  more  informative  calls  early). 

Do  not  use  calls  that  can  be  misinterpreted  by  the  pilot  as  "go  for 
it"  until  the  ramp  is  made,  no  matter  what  the  pressure  to  get  the 
aircraft  aboard. 

In  high  workload  situations  involving  MOVLAS,  consider  dividing  the 
controlling  LSO  workload  (one  with  MOVLAS,  one  with  radio). 

When  supervisory  personnel  demonstrate  confusion  or  incompetence,  LSO 
must  know  the  rules  (i.e.  max.  engaging  speeds,  ramp  "tap"  to  divert 
or  barricade,  crosswind  limits,  etc.)  and  be  prepared  to  assert  him¬ 
self  ("hang  it  out")  to  insure  correct  action  is  taken. 

When  CCA  "loses  the  bubble"  on  aircraft  control,  LSO  must  be  prepared 
to  safely  salvage  the  situation. 

Under  ZIPLIP/EMCON  conditions,  safety  is  still  paramount,  therefore, 
do  not  hesitate  to  use  voice  calls  as  needed. 

Do  not  allow  use  of  platform  calls  like  "wire  coming  back"  and  "good 
chance".  They  could  influence  the  controlling  LSO  to  press  the 
waveoff  ooint  in  a  foul  deck  situation. 

When  directed  to  wave  under  obviously  unsatisfactory  recovery  condi¬ 
tions  (i.e.  insufficient  WOO,  excessive  crosswind,  etc.),  the  pickle 
can  be  a  very  effective  tool  for  aborting  the  recovery  process. 
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When  late  wlre(s)  Is  missing  and  roll  angle  has  been  changed,  do  not 
forget  that  hook-to-ramp  clearance  has  been  reduced. 

For  barricade  engagement,  give  “cut"  call  prior  to  engagement,  but 
only  after  ramp  Is  made. 

For  barricade  recovery,  remember  that  pilot's  view  of  meatball  will  be 
lost  temporarily  In-close. 

For  barricade  recovery,  waveoff  point  must  be  moved  out  significantly. 

For  barricade  recovery,  remember  that  hook-to-ramp  clearance  is  re¬ 
duced  and  that  basic  angle  Is  4.0  degrees. 

For  barricade  recovery,  remember  that  hook-to-ramp  and  hook  touchdown 
point  are  different  for  each  aircraft  type. 

Use  dynamic  hook-to-ramp  and/or  CLASS  indicator  to  help  detect  out-of¬ 
trim  condition  for  ship  and  Its  effect  on  hook-to-ramp  clearance  and 
touchdown  point. 

Avoid  allowing  a  R-L  drift  particularly  when  ship  has  port  list. 

Avoid  allowing  a  L-R  drift  particularly  when  ship  has  a  starboard 
list. 

With  a  ramp  out-of-trim  condition,  touchdown  angle  is  changed.  Try  to 
minimize  excess  sink  rate  landings  for  ramp  down  condition. 

With  a  starboard  side  MOVIAS,  expect  some  breakdown  In  Dilot  scan. 

If  the  pilot  Is  flying  poorly  and  If  CCA  Is  well  out  of  limits,  use 
"Paddles  Contact"  or  directional  calls  Inside  2  miles  to  help  avoid  an 
extremely  poor  start. 

Hove  the  waveoff  point  out  when  there  are  men  on  deck  or  aircraft  in 
landing  area. 

Roll  angle  changes  to  move  targeted  touchdown  point  should  be 
considered  for  missing  wires  and  for  excessive  out-of-trim  condition. 

CATCC  voice  calls  may  Indicate  that  the  SPN-42  glideslope  is 
improperly  calibrated.  Inform  them  If  such  is  the  case. 

If  closure  speed  readout  is  not  available  on  the  platform,  consider 
asking  for  speed  calls  from  Air  Boss  or  CATCC. 

For  a  barricade  recovery,  check  the  ship's  trim  and  make  apDropriate 
adjustments  to  targeted  touchdown. 
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For  normal  recovery  ops,  on-glldeslope  hook-to-ramp  clearance  should 
never  be  less  than  10  feet. 

For  a  barricade  recovery,  on-gl Ideslope  hook-to-ramp  clearance  should 
never  be  less  than  8  feet. 

If  during  a  recovery,  there  are  a  lot  of  relatively  smooth  bolters  or 
early  wires.  It  may  be  a  Indication  that  the  ship  Is  out  of  trim. 

Recommend  a  change  In  targeted  touchdown  point  when  an  out-of-trim 
condition  causes  a  change  In  touchdown  point  by  about  half  the 
distance  betwee'n  wires.  Also,  when  the  4  wire,  or  4  and  3  wires  are 
missing. 
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APPENDIX  E 

PILOT/AIRCRAFT  BEHAVIOR  MOOELS 

This  appendix  describes  the  pilot  and  aircraft  behavior  models  resul¬ 
ting  froia  this  study.  Modelling  Information  for  other  carrier  landing 
situation  factors  Is  also  Included.  The  models  are  Intended  to  provide 
guidance  In  the  Implementation  of  simulation  and  control  functions  for 
representation  of  carrier  landing  situations  for  LSO  training.  Table  E-l 
provides  an  outline  of  the  models  and  their  elements.  The  Interaction  of 
these  models  within  an  LSO  training  system  context  are  depicted  In  Figure 
E-l.  The  remainder  of  this  appendix  provides  discussion,  tables  and  figures 
which  describe  each  of  the  three  modelling  areas. 


TABLE  E-l.  OVERVIEW  OF  MODELS  AND  ELEMENTS 

PILOT  MODEL: 

Pilot  Response  (to  LSO) 

Approach  Profiles 
Simple  Profiles 
Complex  Profiles 
Critical  Outcome  Profiles 

Background  Characteristics 
Experience 
Proficiency 
Skill 

Tendencies 

Condition 

AIRCRAFT  MODEL: 

Aircraft  Type 

Aircraft  Status 
Malfunctions 
Configuration 
Approach  Mode 
Fuel  State 

OTHER  SITUATION  FACTORS: 

Environment 

Ship 

Operations 
LSO  Station 


Figure  E-1.  Models  Interaction 
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APPROACH  SEGMENTATION  AND  SYMBOLOGY 


A  major  consideration  In  the  modelling  of  pilot  behavior  is  the 
segmentation  of  approach  dynamics  for  representing  the  results  of  simulated 
pilot  actions.  LSO  oriented  terms  are  used  as  much  as  possible  to  represent 
the  segmentations  which  are  discussed  In  subsequent  paragraphs. 


Parameters  of  Initial  Interest  are  those  which  provide  "snapshot" 
depictions  of  an  approach:  range,  glideslope  position,  lineup  position  and 
AOA.  Range  is  commonly  segmented  by  LSOs  Into  four  components:  start  (X), 
In  the  middle  (IM),  In  close  ( I C> ,  and  at  the  ramp  (AR).  To  denote  that  a 
deviation  has  existed  throughout  the  approach,  the  term  "all  the  way"  (AW) 
is  used.  For  the  purposes  of  modelling,  additional  range  segmentations  are 
needed.  They  are  depicted  below: 


The  common  LSO  segmentations  for  glideslope  and  lineup  position,  and 
AOA  appear  adequate  for  approach  description  purposes.  These  parameters  are 
depicted  in  Figure  E-2.  Note  that  parentheses  modify  a  basic  descriptor  to 
mean  "slightly"  and  that  underlining  of  a  basic  descriptor  indicates  a 
larger  deviation.  For  example:  very  high;  H  *  high;  (H)  =  slightly 
high.  If  additional  segmentation  is  ever  required,  a  "+"  and  scheme 
can  be  used.  For  example,  the  glideslope  position  segment  H  (very  high)  can 
be  further  broken  Into  three  Increments  (H+,  H,  H-)  using  such  a  scheme. 
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There  are  also  dynamic  parameters  which  must  be  represented.  Among  the 
dynamic  parameters,  sink  rate  and  drift  rate  are  of  prime  importance  to  the 
LSO.  Sink  rate  Is  the  rate  of  descent  of  the  aircraft  during  approach. 
There  Is  a  nominal  sink  rate  for  maintaining  the  existing  angular  glide- 
slope  position.  Variations  from  the  nominal  rate  cause  the  aircraft  to  go 
higher  (not  enough  rate  of  descent,  or  NERD)  or  lower  (too  much  rate  of 
descent,  or  TMRD).  Drift  rate  Is  associated  with  changes  in  1  ineup  posi¬ 
tion.  Drift  Is  represented  by  the  prefix  DR  and  followed  by  the  direction 
of  drift  (R  for  right,  or  L  for  left).  Sink  rate  and  drift  rate  segmenta¬ 
tions  are  delineated  below: 


Sink  Rate: 


NERD 

Drift  Rate: 

DRR 

NERD 

DRR 

(NERD) 

(DRR) 

OK 

OK 

(TMRD) 

(DRL) 

V 
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Pitch  and  power  changes  are  also  parameters  of  concern  In  an  approach. 
Pitch  denotes  abrupt  changes  In  nose  position  and  Is  represented  by  the 
terms  "drop  nose"  (ON)  and  "pulled  nose  up"  (PNU)  for  discrete  changes,  and 
"rough  nose"  (RUFN)  for  frequent  changes  In  nose  position.  Power  denotes 
changes  In  thrust  based  on  the  throttle  movements  of  the  pilot.  "Too  much 
power"  (TMP)  usually  leads  to  a  decrease  In  sink  rate  or  AOA  (accelera¬ 
tion).  "Not  enough  power"  (NEP)  usually  leads  to  an  Increase  In  sink  rate 
or  AOA  (deceleration).  Frequent,  excessive  power  changes  during  approach  is 
represented  by  "rough  power"  (RUFP).  An  abrupt  reduction  In  power  is  repre¬ 
sented  by  "ease  gun"  (EG).  Full  throttle  ("military  power"),  as  for  a 
waveoff,  Is  represented  by  MP.  A  final  parameter  of  Interest  Is  wing  posi¬ 
tion.  Abrupt  changes  In  wing  position  (roll)  are  represented  by  the  terms 
"left  wing  down"  (LWO)  and  "right  wing  down"  (RWD).  Pitch,  power  and  roll 
segmentations  are  delineated  below: 


Pitch: 


RUFN 

Power: 

RUFP 

Roll: 

RWD 

DN 

MP 

(RWD) 

m 

TMP 

OK 

(DN) 

W 

(LWD) 

OK 

(TMP) 

LWD 

(PNU) 

OK 

PNU 

(NEP) 

PNU 

NEP 

NEP 

TtT 

Other  examples  of  ISO  "shorthand"  symbols  which  will  be  used  in 
describing  approach  profiles  Include: 

CD  *  come  down  (CDAR  *  come  down  at  ramp) 

S  *  settle  (SIC  *  settle  In  close) 

.  -  on  (S  .  X  ■  settle  on  start) 

OC  ■  overcontrolled  (OCHIC  *  overcontrolled  high  In  close) 

C  *  climb  (CIC  *  climb  in  close) 

*0  »  "over  the  top";  bolter 

OK  *  okay  (optimum  segment  for  dimension  or  dynamic  parameter) 

GS  *  gll  deslope 

LU  *  lineup 

TL  ■  to  land  (ONTL  *  drop  nose  to  land) 

AFU  *  all  fouled  up 

DEC  •  decelerate;  slow  down 

ACC  *  accelerate 

LLU  *  late  lineup 

CU  ■  cocked  up 

B  »  flat  gll  deslope 

Reference  will  be  made  to  approach  segmentation  and  symbology  In  the  model 
descriptions  to  follow.  The  codes  specified  for  these  segmentations  should 
also  be  considered  for  use  In  man-machine  Interfaces  (display  and  Input). 
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PILOT  MODEL 

There  are  three  elements  of  the  pilot  model.  One  Involves  the  response 
of  the  pilot  to  LSO  calls  and  signals.  Another  Involves  approach  profiles 
of  aircraft  control  prior  to,  or  independent  of,  LSO  Intervention.  The 
third  element  Is  associated  with  background  characteristics  and  tendencies 
of  individual  pilots. 

PILOT  RESPONSE.  From  an  LSO  training  standpoint,  the  operationally  effec¬ 
tive  LSO  must  learn  how  to  handle  several  pilot  response  characteristics. 
Each  can  be  very  critical  to  the  success  of  an  approach,  from  both  a  safety 
and  an  expeditious  recovery  perspective.  Undeslreable  pilot  response 
characteristics  Include: 

o  no  response  to  LSO  call /signal 

o  over/under-control  response 

o  "wrong  way"  response 

o  slow  response 

These  characteristics  when  known  (as  pilot  tendencies)  or  recognized  (in 
real-time)  Influence  the  decisions  of  the  LSO  regarding  calls/signals  to  be 
used  during  an  approach.  They  also  have  some  Influence  on  recovery  strategy 
decisions.  However,  the  focus  for  this  portion  of  pilot  behavior  modelling 
Is  primarily  on  teaching  aircraft  control  strategies  (waving  approaches)  to 
the  LSO  trainee.  The  pilot  response  element  of  a  pilot  behavior  model  must 
be  able  to  realistically  simulate  real-time  LSO/pilot  Interaction  for  the 
characteristics  above.  Additionally,  the  characteristics  must  be  selec^ble 
based  on  syllabus  control  decisions  from  the  Instructor  model. 

There  are  several  factors  which  can  Influence  the  realistic  represen¬ 
tation  of  various  pilot  response  characteristics.  One  of  these  factors  is 
whether  the  pilot  evaluates  the  relative  "correctness"  of  the  LSO  call  or 
signal  prior  to  selecting  a  response.  One  case  Involves  the  pilot  who 
trusts  the  LSO  and  responds  to  the  call  or  signal  regardless  of  its  vali¬ 
dity.  The  other  case  Involves  a  "smart"  pilot  who  evaluates  the  deviation 
Implied  by  the  call  and  Initiates  a  response  Influenced  more  by  the 
deviation  than  by  the  call.  Thus  enters  another  factor  In  pilot  response: 
the  relationship  of  the  LSO  call  to  the  existence  (or  non-existence)  of  a 
deviation.  There  are  several  alternatives  which  may  affect  response  selec¬ 
tion  for  the  "smart"  pilot: 

o  no  deviation  exists 
o  deviation  agrees  with  LSO  call 

o  deviation  opposite  to  that  Implied  by  call 

(high  vs  low,  left  vs  right) 
o  deviation  may  be  unrelated  to  call  (lineup  call 
when  glldeslope  deviation  exists) 

In  the  absence  of  a  deviation  or  for  an  unrelated  call ,  the  "smart"  pilot 
Is  not  likely  to  respond.  For  a  call  opposite  to  the  direction  of  deviation 
and  for  a  correct  call  the  "smart"  pilot  Is  likely  to  Initiate  a  response. 
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Another  factor  is  the  quality  of  pilot  response.  There  are  two  aspects 
Involved:  correctness  and  timeliness.  Correctness  may  vary  among  several 
alternatives: 

o  good  response 

o  over  response 

o  under  response 

o  response  In  wrong  direction 

A  good  response  either  corrects  the  existing  deviation  (If  valid  call) 
or  responds  correctly  to  the  call.  For  over  response  the  pilot  goes  In  the 
proper  direction  suggested  by  the  call  or  the  deviation  but  goes  too  far 
(l.e.  call  "You're  Low"  and  aircraft  goes  from  low  deviation  to  high  devia¬ 
tion).  For  an  under  response  the  pilot  goes  in  the  proper  direction  but 
doesn't  give  a  complete  response  to  the  call  or  deviation  (l.e.,  call 
"You're  Low"  and  aircraft  goes  from  very  low  to  slightly  low).  For  a  wrong 
way  response,  the  pilot  response  Is  in  the  wrong  direction  In  relationship 
to  the  call  or  deviation  (l.e.,  call  "You're  Low"  and  aircraft  goes  lower). 
The  timeliness  aspect  Is  associated  with  how  quickly  the  pilot  Initiates 
the  response  (fast  or  slow). 

Another  consideration  In  the  modelling  of  pilot  responses  is  that 
pilot  characteristics  may  vary  among  the  three  dimensions  of  an  approach: 
glldeslope,  lineup  and  AOA.  The  pilot  may  be  very  responsive  to  glideslope 
deviations  and  related  calls,  but  unresponsive  in  the  lineup  dimension. 

Pilot  response  modelling  is  also  Influenced  by  whether  the  LSO  is 
utilizing  the  MOVLAS  during  recovery.  If  the  MOVLAS  is  not  being  used,  the 
LSO  Interventions  in  an  approach  are  voice  calls  and  discrete  light  signals 
(cut  and  waveoff  lights).  If  the  MOVLAS  is  being  used,  the  LSO  Is  presen¬ 
ting  continuous  glideslope  Information  as  a  substitute  for  the  Fresnel 
lens.  The  LSO  may  also  use  voice  calls  and  discrete  light  signals  when 
MOVLAS  Is  In  use. 

Two  sets  of  pilot  response  modelling  logic  were  devised  for  these 
factors.  The  first  Is  based  on  discrete  LSO  actions  (voice  calls/light 
signals).  The  other  is  for  MOVLAS  utilization.  The  logic  for  pilot 
response  to  discrete  LSO  actions  Is  depicted  in  Figure  E-3.  For  the  logic, 
four  factors  are  pre-deflned  by  syllabus  decision  functions  and  known  by 
simulation  control : 

pilot  response  -  yes,  no 

pilot  response  to  deviation  -  yes  ("smart"  pilot), 

no  ("trusting"  response  to  call) 
quality  of  response  desired  -  good,  wrong  way,  under,  over 
speed  of  response  -  fast,  slow 

If  thcie  characteristics  differ  by  approach  dimension,  call/signal  or 
range,  this  fact  is  also  pre-deflned.  There  are  also  two  tables  associated 
with  logic  output.  One  specifies  the  responses  to  deviations  for  the 
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"smart"  pilot.  The  other  provides  various  responses  to  specific  calls/ 
signals  for  the  "trusting"  pilot.  Within  the  two  tables  are  provisions  for 
responses  of  varying  quality  levels. 

Figure  E-3  depicts  the  logic  flow  after  Initial  screening  for  differe¬ 
nces  In  pre-defined  factors  based  on  dimension,  call/signal  and  range.  The 
logic  starts  with  a  question  of  whether  the  pilot  Is  to  respond.  If  a 
responsive  pilot  Is  selected  then  the  question  Is  whether  he  responds  to 
the  deviation  ("smart"  pilot)  or  the  call  ("trusting"  pilot).  Subsequent 
flow  for  "smart"  pilot  responses  leads  to  the  question  of  whether  the  voice 
call  Is  In  the  same  approach  dimension  (GS/Lll/AOA)  as  the  deviation.  If  not 
there  is  no  response,  since  the  call  Is  unrelated  to  the  deviation.  If  the 
call  Is  related  to  the  deviation,  even  if  in  the  wrong  direction,  then  the 
question  of  response  quality  arises.  Subsequent  questions  In  the  flow  lead 
to  the  determination  of  whether  the  response  is  to  be  "good",  "wrong  way", 
"over"  or  "under".  This  determination  In  conjunction  with  the  type  of 
existing  deviation  is  Input  to  the  selection  of  a  response  from  Table  E-2. 
The  final  step  In  the  "smart"  pilot  logic  Is  the  determination  of  response 
speed  (fast  or  slow). 

The  portion  of  logic  for  the  "trusting"  pilot,  as  noted  earlier  in  the 
flow,  leads  to  the  determination  of  response  quality  as  In  the  case  of  the 
"smart"  pilot.  This  determination  Is  used  in  conjunction  with  the  voice 
call  or  signal  to  select  the  appropriate  response  from  Table  E-3.  The  flow 
Is  completed  with  the  selection  of  response  speed  (fast  or  slow).  The 
parenthetical  numbers  In  the  blanks  of  Table  E-3  are  Intended  to  show 
relative  differences  among  the  responses. 

Some  of  the  responses  delineated  In  Table  E-2  (l.e.  go  lower,  go  to 
high  deviation,  etc.)  will  eventually  need  more  specificity.  However,  the 
level  of  specificity  will  probably  have  to  be  determined  during  developmen¬ 
tal  testing.  A  similar  statement  applies  to  the  responses  In  Table  E-3. 

The  logic  for  pilot  response  to  MOVLAS  signals  Is  similar  to  that 
presented  earlier  for  the  "trusting"  pilot.  An  exception  Is  that  MOVLAS 
signals  are  only  related  to  glldeslope  positioning  during  approach.  Addi¬ 
tionally,  a  MOVLAS  controlled  approach  Is  likely  to  also  Include  voice 
calls  and  discrete  light  signals.  Therefore,  their  response  logic  is  also 
applicable  when  MOVLAS  Is  In  use.  When  MOVLAS  indications  are  in  disagree¬ 
ment  with  discrete  signals,  the  pilot  Is  likely  to  be  r.  re  responsive  to 
discrete  signals.  Therefore,  In  such  a  case  the  response  ^ogic  for  discrete 
signals  and  "trusting"  pilot  should  take  priority  over  MOVLAS  response 
logic. 


Figure  E-4.  Pilot  Response  Logic  for  Discrete  LSO  Actions 
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TA8LE  E-2.  RESPONSES  BY  DEVIATION 
("Smart"  Pilot) 


Deviation 


Response  (G  3  good,  W  3  wrong  way,  0  =  over,  U 


Low 


High 


Left 


Right 


Fast 


Slow 


G  3  correct  the  deviation 
W  3  go  lower 
0  3  go  to  high  deviation 
U  3  correct  only  half  the  deviation 

G  3  correct  the  deviation 
W  3  go  higher 
0  3  go  to  low  deviation 
U  -  correct  only  half  the  deviation 

G  3  correct  the  deviation 
W  3  go  further  left 
0  3  go  to  right  deviation 
U  3  correct  only  half  the  deviation 

G  3  correct  the  deviation 
W  3  go  further  right 
0  3  go  to  left  deviation 
U  3  correct  only  half  the  deviation 

G  3  correct  the  deviation 
W  3  accelerate 
0  3  go  to  slow  deviation 
U  3  correct  only  half  the  deviation 

G  3  correct  the  deviation 
W  3  decelerate 
0  3  go  to  fast  devia  ion 
U  3  correct  only  ha  the  deviation 


Note:  Maintain  other  approach  parameters  in  a:cordance  with  profile. 


3  under) 
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TABLE  E-3 


Call /Signal 


You're  (a  1 1 ttle) HI gh 


You're  (a  little)  Low 


You're  Lined  Up  Left; 
Right  for  Lineup 


You're  Lined  Up  right; 
Left  for  Lineup 


You're  Going  High; 
Don't  Go  High; 
Don’t  Climb 


You're  Going  Low; 
Don't  Go  Low; 
Don't  Settle 


You're  Fast 


You're  Slow 


.  RESPONSES  BY  DISCRETE  LSO  ACTIONS 
("Trusting"  Pilot) 

Response  (G  8  good,  W  ■  wrong  way, 
0  *  over,  U  ■  under) 


G  ■  go  down  (2)  GS  increments 
W  ■  go  up  (2)  GS  increments 
0  8  go  down  (4)  GS  increments 
U  8  go  down  (1)  GS  increment 

G  8  go  up  (2)  GS  increments 
W  8  go  down  (2)  GS  increments 
0  *  go  up  (4)  GS  increments 
U  8  go  up  (1)  GS  increments 

G  8  go  right  (2)  LU  increments 
W  8  go  left  (2)  LU  increments 
0  8  go  right  (4)  LU  increments 
U  8  go  right  (1)  LU  increment 

G  8  go  left  (2)  LU  increments 
W  8  go  right  (2)  LU  increments 
0  8  go  left  (4)  LU  increments 
U  8  go  left  (1)  LU  increment 


G 

W 

0 

U 


increase  sink  rate  (2) 
decrease  sink  rate  (2) 
increase  sink  rate  (4) 
increase  sink  rate  (1) 


increments 

increments 

increments 

increment 


G 

W 

0 

U 


decrease  sink  rate  (2) 
increase  sink  rate  (2) 
decrease  sink  rate  (4) 
decrease  sink  rate  (1) 


increments 

increments 

increments 

increment 


G  8  decelerate  (2)  AOA  increments 
W  8  accelerate  (2)  AOA  increments 
0  8  decelerate  (4)  AOA  increments 
U  8  decelerate  (l)  AOA  increment 

G  8  accelerate  (2)  AOA  increments 
W  8  decelerate  (2)  AOA  increments 
0  8  accelerate  (4)  AOA  increments 
U  8  accelerate  (1)  AOA  increment 


TABLE  E-3. 


(A  little)  Power; 
cut  lights 


(A  little)  Attitude 


Waveoff ; 
waveoff  lights 
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RESPONSES  BY  DISCRETE  LSO  ACTIONS  (Continued) 
("Trusting"  Pilot) 


6  *  add  power*  decrease  sink  rate  (2)  increments 
W  ■  decrease  power.  Increase  sink  rate  (2) 
increments 

0  *  add  power,  decrease  sink  rate  (4)  increments 
U  ■  add  power,  decrease  sink  rate  (1)  increment 


6  ■  add  power,  increase  pitch  (2)  increments, 
decrease  sfnk  rate  (2)  increments 
W  *  decrease  power,  decrease  pitch  (2)  increments, 
increase  sink  rate  (2)  increments 
0  *  add  power,  increase  pitch  (4)  increments, 
decrease  sink  rate  (4)  increments 
U  *  add  power.  Increase  pitch  (1)  increment, 
decrease  sink  rate  (1)  increment 


6  ■  add  full  power,  increase  pitch  (2)  increments, 
decrease  sink  rate  (2)  increments 
W  *  decrease  power,  decrease  pitch  (2)  increments, 
increase  sink  rate  (2)  increments 
0  *  add  full  power.  Increase  pitch  (4)  Increments, 
decrease  sink  rate  (2)  increments 
U  *  add  full  power,  increase  pitch  (1)  increment, 
decrease  sink  rate  (1)  Increment 


Note:  Maintain  other  approach  parameters  in  accordance  with  profile. 
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The  logic  devised  for  pilot  response  to  MOVLAS  signals  Is  depicted  In 
Figure  E-4.  This  flow  essentially  leads  to  the  quality  and  speed  of  glide- 
slope  responses.  These  responses  are  related  to  MOVLAS  control  positioning 
by  the  LSO.  Since  pilot  responses  to  MOVLAS  signals  Involve  human  tracklnq. 
It  will  probably  Increase  response  realism  If  some  random  variability 
of  response  characteristics  is  desiqned  for  implementation  of 
the  MOVLAS  response.  However,  the  majority  of  time  the  response 
characteristics  should  be  those  specified  for  the  exercise. 

APPROACH  PROFILES.  Approach  profiles  represent  pilot  behaviors  In  the 
control  of  aircraft  during  approach  in  the  absence  of  LSO  intervention.  In 
an  LSO  training  system  they  are  useful  In  helping  the  trainee  learn  to 
perceive  deviations  and  relate  them  to  appropriate  calls.  The  profiles  are 
also  useful  In  helping  the  trainee  build  cognitive  processing  schemes  for 
anticipating  future  deviations  based  on  observed  trends.  The  most  important 
use  of  the  profiles  Is  to  help  the  trainee  learn  how  to  handle  critical 
approaches,  those  which  frequently  lead  to  undesireable  landing  results. 
The  descriptive  symbology  presented  earlier  and  other  LSO  "shorthand"  terms 
will  be  used  frequently  for  describing  profiles  in  subsequent  discussions 
and  tables.  For  the  pilot  model,  three  categories  of  approach  profiles  have 
been  Identified  and  are  outlined  and  discussed  below: 

SIMPLE  PROFILES: 

Glldeslope  Deviations 
Lineup  Deviations 
AOA  Deviations 

Multi-dimensional  Deviations 

COMPLEX  PROFILES: 

Pilot  Tendencies 
Other  Trends 

CRITICAL  OUTCOME  PROFILES: 

Hard  Landing/Ramp  Strike 
Off-center  Engagement 
Bol ter 

Inflight  Engagement 

The  simp! e  prof  11 1 es  Include  relatively  simple  approach  deviation 
situations.  They  are  primarily  useful  for  teaching  the  trainee  to  recognize 
deviations  and  relate  those  deviations  to  the  use  of  voice  calls  and  light 
slonals.  The  simple  profiles  are  delineated  In  Table  E-4.  The  listing  of 
multi-dimensional  profiles  In  the  table  Is  extensive  but  does  not  Include 
all  possible  combinations  of  deviations.  For  all  the  simple  profiles, 
additional  variability  Is  available  using  the  segmentation  modifiers  des¬ 
cribed  earlier.  For  example,  additional  variations  of  the  profile  HIC 
can  Include  jllC  and  (H) I C. 
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Does  the  pilot  respond? 


no  - >(No  response) 


yes 


Good  response  desired? 


yes - >fast  response? - >  yes 

no  no 


Wrong  way  response  desired? 


no 


->  yes - >  fast  response? - >  yes 

no 


Over  response  desired? 


^yes - >  fast  response?- 

no  (under)  rfo 

vl' 

fast  response? 


yes 


IS. 

V 


yes 


no 


Note: 

GOOD  *  Change  position  by  amount  indicated  by  M0VLAS  positioning 

WRONG  *  Change  position  by  amount  Indicated  but  in  wrong  direction 

OVER  *  Change  position  by  twice  the  amount  indicated 

UNDER  *  Change  position  by  half  the  amount  indicated 


Figure  E-5.  Response  Logic  For  MOVLAS  Signals 
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TABLE  E-4.  SIMPLE  PROFILES 
Glideslope  Deviations: 


HX 

HIC 

HAW 

LOX 

LOIC 

LOAW 

HIM 

HAR 

LOIM 

LOAR 

Lineup  Deviations: 

LULX 

LULIC 

LULAW 

LURX 

LURIC 

LURAW 

LULIM 

LULAR 

LURIM 

LURAR 

AOA  Deviations: 

FX 

FIC 

FAW 

SLOX 

SLOIC 

SLOAW 

FIM 

FAR 

SLOIM 

SLOAR 

Multi-dimensional 

Deviations: 

HFX 

LOSLOIM 

LOSLOIC 

HFAR 

LOSLOX 

LOLULIM 

LOLULIC 

LOSLOAR 

HLULX 

HLURIM 

LOLURIC 

LOLULAR 

LOLURX 

HFIM 

HLULIC 

LOLURAR 

SLOLULX 

LOLURIM 

HFIC 

HLURAR 

FLURX 

SLOLULIM 

HLORIC 

HLULAR 

Complex  profiles  are  Intended  to  acquaint  the  trainee  with  common 
approach  trends  and  pilot  tendencies,  and  help  him  learn  to  anticipate 
future  deviations  based  on  observed  trends.  The  first  set  of  complex  pro¬ 
files  to  be  addressed  are  those  associated  with  pilot  tendencies.  A  tactic 
which  may  be  useful  in  an  LSO  training  system  context  is  to  relate  the 
pilot  tendency  profiles  to  pilot  "labels".  Some  pilot  "label"  examples  and 
related  profiles  include: 

o  "Deck  Spotter"  -  a  tendency  to  drop  nose  and/or  ease  power  in 
close  or  at  the  ramp;  usual  result  is  excessive  sink  rate  and 
early  wire  with  less  than  optimum  hook-to-ramp  clearance. 

(HIC)  DN/EG  IC-AR 

o  "Moth”  -  tendency  to  drift  left  in  close  or  at  the  ramp  ("fly  to 
the  light  of  the  lens")  DRL  IC-AR 

o  "Ramp  Shy"  -  tendency  to  deviate  high  at  the  ramp;  usual  result  is 
bolter.  OCOKIC  TMPAR 
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o  "Death  Wish"  or  "No  Fear  of  Death"  -  tendency  similar  to  that  of 
"Deck  Spotter";  pilot  drops  nose  and/or  eases  power  In  close  even 
though  he  Is  below  glideslope.  LOIC  DN/EG 

o  "4  Degree  Glideslope"  -  tendency  to  start  high  and  work  off 
deviation  very  gradually  to  a  low  or  sightly  low  deviation  with 
excess  sink  rate  at  the  ramp.  HX-IM  (HIC)  CDAR 

o  "Low  Flat  All  the  Way"  -  tendency  to  start  low  and  correct  for 
the  deviation  too  slowly;  usual  result  Is  bolter  or  LOAR. 
LOIM  LOIC  (LOAR) 

o  "Tunnel  Vision"  -  tendency  to  work  on  one  deviation  while 
neglecting  control  of  another  approach  dimension.  For  example, 
pilot  works  on  a  lineup  deviation,  neglects  glideslope  cues  and 
goes  low.  LULX-IM  TMRDIC  LOAR 

These  and  other  pilot  tendency  profiles  are  delineated  In  Table  E-5.  Other 
complex  trends  are  also  listed.  These  listings  cannot  be  considered  exhaus¬ 
tive  but  should  be  useful  as  a  departure  point  for  future  expansion. 

Critical  outcome  profiles  are  those  which  historically  have  been 
associated  with  undeslreable  landing  results.  Within  this  category  the 
profiles  are  grouped  by  landing  outcome.  The  profiles  and  their  groupings 
are  delineated  and  discussed  below: 

Ramp  Strike/Hard  Landing: 

LOX  HIM-IC  CDAR 
'  HX-IC  CDAR 

OC  Cl C/HI C  CDAR 
NEPAW  SAR 
SAR  on  LLU 

EG/DN  correcting  for  LOIC 

Off-Center  Engagement: 

LURX/IM  R-LAW 
LUL?/IM  L-RAW 
OCLULIC  L-RAR 
OCLURIC  R-LAR 
DRRIC/AR 
DRLIC/AR 

Bol ter: 

OCLOIC/SIC  <r* 

TMP  on  LLUIC 

Infllg't  Engagement: 

OCCDAR  PNU 
LOBIC  PJJUKft 
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TABLE  E-5.  COMPLEX  PROFILES 


Pilot  Tendencies: 

Deck  Spotter 

Moth 
Ramp  Shy 
Death  Wish 
4  Degree  Glideslope 
Low  Flat  All  the  Way 
Tunnel  Vision 

Cowboy 

Wanderer 
Low  Nlbbler 
Nugget 

Accel erator 
Nosey 
Black  Hole 
Slow  Nlbbler 
Tall  Dragger 
Swooper 
High  Dipper 
Nervous 
Old  Pro 
Shaky  Starter 


(HIC)  DN/EG  IC-AR 
CCIC)  DN/EG  TL 
HAR  DN/EGTL 

DRLIC-AR 

OC  OK  IC  TMPAR 

LOIC  DN/EG 

HX-IM  (HIC)CDAR 

LOIM  LOIC  (LOAR) 

LOX-IM  DRLIC  LULAR 
LULX-IM  TMRDIC  LOAR 

HX  LOIM  HIC  LOAR 
LOX  HIM  LOIC  HAR 

LULX  LURIM  LULIC  DRRAR 

LOX  (LOIM)  LOIC  (.LOAR) 

OC  (HIM)  CDIC 
OC  (LOIM)  HIC 
OC  (SLOIM)  HFIC 

(FX)  FIM  FIC-AR 
RUFN  RUFGS  AW 
S*X  LOIM 

SLOX  (SLOIM)  SLOIC  (SLOAR) 

(HIC)  NEP  PNU  CUAR 

HLULIM  DN/DRRIC-AR 

HIC  DNIC  PNUAR 

RUFP  RUFGS  AW 

(HAW)  (DN/EGAR) 

HX  AFUAW 
LOX  AFUAW 


Other  Complex  Trends: 

OCHFX  LOIM  HIC  DECIM  LOSLOLULIC 
OCLOSLOX  HIM  COIC  TMPIM  HFIC  DRLAR 
LURIM  SIC*LLU  OCFIM  SIC  LOBAR 
OCLULIM  L-RIC 
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Ramp  strike/hard  landing  profiles  are  the  most  critical  in  terms  of 
landing  results.  These  profiles  also  have  a  higher  likelihood  of  occurrence 
in  actual  fleet  operations  than  those  In  the  other  groupings.  The  terminal 
portions  of  the  profiles  In  this  grouping  are  similar,  involving  a  signifi¬ 
cant  deviation  below  optimum  glideslope  (a  "comedown").  However,  there  are 
significant  variances  In  the  profile  leading  to  the  "comedown".  The  most 
common  trend  Is  a  deviation  above  glideslope  within  the  "In  close"  portion 
of  the  approach.  The  “comedown"  results  when  the  pilot  makes  an  excessive 
pitch  and/or  power  correction  for  this  deviation  or  when  the  pilot  falls, 
or  Is  slow,  to  make  a  re-correction  to  reduce  sink  rate  to  within  accept¬ 
able  parameters.  There  are  also  typical  deviations  which  occur  early  In  ap¬ 
proaches  (prior  to  the  In  close  area).  The  most  common  Is  a  low  glideslope 
deviation  In  the  middle  portion  of  an  approach. 

Off-center  engagement  profiles  are  also  relatively  critical,  although 
less  so  than  those  discussed  earlier.  Off-center  landings.  If  drastic,  can 
result  In  an  aircraft  drifting  off  the  port  side  of  the  carrier  (with  or 
without  engagement  of  an  arresting  cable)  or  drifting  Into  aircraft  parked 
outside  the  landing  area.  They  can  also  cause  time  consuming  Inspections  of 
the  arresting  gear  machinery  and.  In  the  worst  case,  actual  damage  to  the 
machinery.  Fortunately,  drastic  off-center  landings  are  Infrequent  occur¬ 
rences. 

Bolter  profiles  are  of  significance  to  L SO  waving  performance 
primarily  from  an  "expeditious  recovery"  perspective.  This  perspective 
becomes  critical  when  there  Is  a  strong  operational  requirement  for  getting 
an  aircraft  aboard  (such  as  In  a  low  fuel  state,  no  tanker,  no  divert 
situation).  An  extremely  long  bolter  can  be  a  dangerous  situation  In  which 
there  may  be  Insufficient  landing  area  remaining  for  aircraft  rotation  and 
lift-off.  The  most  typical  bolter  profile  Involves  excessive  pilot  control 
response  to  a  low  glideslope  deviation  In  the  terminal  portion  of  an 
approach. 

Inflight  engagement  profiles  lead  to  results  which  are  generally 
outside  the  direct  Influence  of  the  LSO.  However,  they  are  Included  here 
because  they  can  lead  to  landing  accidents,  and  because  they  are  related  to 
the  LSO  responsibility  for  evaluating  pilot  performance  and  conducting 
pilot  landing  training  (Including  pilot  debriefing  aboard  ship).  The  most 
drastic  result  of  an  Inflight  engagement  on  landing  Is  damage  to  an  air¬ 
craft  as  the  nose  falls  through  from  a  cocked-up  condition  (typically 
collapse  of  the  nose  landing  gear).  Inflight  engagement  typically  occurs 
when  the  pilot  Increases  nose  attitude  excessively  In  response  to  an  excess 
sink  rate  at  the  ramp.  It  can  also  occur  In  response  to  an  LSO  call  (such 
as  "power"  or  "attitude")  or  In  response  to  a  waveoff  when  the  pilot  uses 
poor  waveoff  technique. 

Effective  Implementation  of  the  Simple,  Complex  and  Critical  Outcome 
profiles  described  above  requires  some  variability  In  occurrence  of 
deviations  within  multiple  presentations  of  the  same  profile.  As  an 
example,  the  profile  LOX  CIM/HIM  COIC-AR  Involves: 
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o  low  deviation  at  the  start  (LOX) 
o  high  deviation  In  the  middle  (CIH  or  HIM) 
o  comedown  In  close  or  at  the  ramp  (CDIC-AR) 

Typically,  the  middle  portion  of  an  approach  encompasses  a  range 
segment  between  2,000'  and  4,000'  from  touchdown.  Onset  of  the  high  devia¬ 
tion  should  vary  within  this  range  segment  In  different  scenarios.  The  same 
can  be  said  for  the  other  deviations  called  for  In  this  profile.  These 
variances  enhance  approach  realism  and  provide  multiple  examples  of  similar 
task  stimuli  to  enhance  concept  acquisition  for  the  ISO  trainee's  Instruc¬ 
tional  situation. 

A  "brute  force"  approach  to  defining  profiles  would  Involve  the 
specification  of  a  large  number  of  variations  for  this  profile.  However  a 
more  efficient  approach  would  be  to  specify  the  profile  In  one  general 
statement  and  to  Incorporate  mechanisms  for  randomly  varying  the  deviations 
within  specified  limitations. 

As  an  example,  consider  the  profile  LOIM  HIC.  This  suggests  that  the 
aircraft  should  be  below  optimum  glldeslope  by  a  significant  amount  within 
the  "In  the  middle"  range  zone,  and  later  be  above  optimum  glldeslope  by  a 
significant  amount  within  the  "In  close"  range  zone.  For  the  LSO  training 
system  we  would  want  the  actual  range  of  occurrence  for  the  deviations  and 
the  amount  of  the  deviations  to  vary.  With  the  approach  segmentation  scheme 
described  earlier,  several  variations  of  range  and  deviation  are  available: 


Range 


Below  Glldeslope 


Above  Glldeslope 


IM  «  IM* 

(10)  -  (L0)+ 

(H)  -  (H)- 

IM 

(L0) 

(H) 

IM- 

<L0)- 

(H)+ 

& 

■ 

o 

H  «  H- 

IC  -  IC- 

L0 

H 

IC 

10- 

H+ 

IC 

10+  -  L0+ 

H  ■  H- 

Iff 

W- 

ff+ 

Limitations  In  glldeslope  variation  can  be  Imposed  If  desired,  such  as 
those  Indicated  below: 

L0  »  10+  or  10-  or  L0  or  L0+ 

* 

H  ■  H-  or  H+  or  H  or  H- 
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Given  these  constraints,  some  of  the  variations  of  the  profile  LOIH  HIC 
which  can  be  used  Include: 

LO  IM,  H  IC 
L0+  IM,  H-  IC+ 

UT  IM+ ,  H+  IC 
LO-  IM,  H  IC+ 

.  L0+  IM-,  H-  IC 

W  IM,  H-  IC- 
L0+  IM+7  H  IC- 


The  operations  of  the  profile  modelling  element  can  use  the  segmenta¬ 
tion  scheme  In  conjunction  with  pre-determined  distribution  factors  to 
provide  desired  profile  variances.  The  distributions  can  be  symmetrical  or 
skewed.  For  example,  using  the  LO  term,  the  distribution  of  variances  could 
be  programmed  as: 


symmetrical 

skewed 

(LO)-  «  .05 

(LO)-  ■  .05 

L0+  -  .1 

L0+  «  .05 

LO  *  .7 

LO  ■  .6 

LO-  -  .1 

LO-  -  .2 

LO+  -  .05 

L0+  «  .1 

Skewing  the  distribution  may  be  based  on  such  factors  as  real-world  profile 
trends  or  requirements  for  training  emphasis. 


Implementation  of  this  profile  also  requires  specification  of  the  rate 
of  change  In  glldeslope  position  (sink  rate).  The  example  profile,  LOIM 
HIC,  specifies  that  the  aircraft  goes  from  on  glldeslope  to  below  glide- 
slope  but  the  sink  rate  Is  not  specified.  There  are  two  ways  sink  rate  can 
be  handled  In  the  model.  One  way  Is  to  specify  It  in  the  profile  descrip¬ 
tion.  The  other  Is  to  pre-deflne  a  distribution  of  sink  rate  variances  for 
each  type  of  deviation.  In  most  of  the  profile  descriptions  the  rate  will 
not  be  specified.  It  may  also  be  deslreable  to  vary  the  distributions  of 
rates  as  a  function  of  range.  Table  E-6  delineates  sink  and  drift  rate 
distributions  as  a  function  of  deviation  and  range.  If  It  Is  later  deter¬ 
mined  that  the  rates  require  additional  segmentation,  a  "+"  and  scheme 
can  be  utilized  as  discussed  earlier. 
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TABLE  E-6.  SINK  AND  DRIFT  RATE  DISTRIBUTIONS 


Distribution  By  Range 

Deviation 

Rates 

_X_ 

IM 

IC 

AR 

LO 

(TMRD) 

.2 

.2 

.1 

.1 

TMRD 

.6 

.6 

.6 

.6 

TMRD 

.2 

.2 

.3 

.3 

H 

(NERD) 

.2 

.2 

.1 

.1 

NERD 

.6 

.6 

.6 

.6 

NERD 

.2 

.2 

.3 

.3 

LUL/R-L 

(DRL) 

.2 

.2 

.1 

.1 

DRL 

.6 

.6 

.6 

.6 

DRL 

.2 

.2 

.3 

.3 

LUR/L-R 

(DRR) 

.2 

.2 

.1 

.1 

DRR 

.6 

.6 

.6 

.6 

DRR 

.2 

.2 

.3 

.3 

S/CD 

(TMRD) 

• 

• 

a* 

TMRD 

.6 

.6 

.4 

.4 

TMRD 

.4 

.4 

.6 

.6 

C/#oa 

(NERD) 

- 

• 

• 

• 

NERD 

.6 

.6 

.4 

.4 

NERD 

.4 

.4 

.6 

.6 

OCH, 

(TMRD) 

.1 

.1 

OCC 

TMRD 

.6 

.6 

.5 

.5 

TMRD 

.3 

.3 

.5 

.5 

OCLO, 

(NERD) 

.1 

.1 

OCCD, 

OCS 

NERD 

.6 

.6 

.5 

.5 

NERD 

.3 

.3 

.5 

.5 
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BACKGROUND  CHARACTERISTICS.  The  background  characteristics  of  a  pilot 
which  are  addressed  include  experience  and  proficiency  levels,  skill  level 
(past  performance),.  tendencies  and  condition.  These  factors  can  influence 
the  waving  performance  of  an  LSO.  The  trainee  must  learn  the  effects  of 
these  pilot  factors  on  his  waving  judgments.  He  must  also  learn  not  to 
"lower  his  guard*"  just  because  he  is  waving  a  highly  skilled  and  experi¬ 
enced  pilot.  Even  the  best  pilots  can  make  critical  errors  In  an  approach. 

As  conceived  for  an  LSO  training  system,  these  characteristics  are 
intended  to  be  presented  to  the  trainee  prior  to  an  approach  or  a  recovery 
situation.  In  many  training  situations  they  may  also  be  correlated  to  the 
pilot  response  characteristics  and  approach  profiles  presented  to  the 
trainee,  depending  on  training  session  objectives.  The  variables  associated 
with  pilot  background  char acter ist ics  and  the  relative  values  for  each 
variable  are  listed  and  discussed  below: 


Variable  Values 

Experience  High 

Low 

Proficiency  High 

tow 

Skill  Level  High 

Average 

Low 

Tendencies  None 

Various(rel ated  to  Complex 
Profiles) 

Condition  Normal 

Fatigued 

Disoriented 


Exp*vi C'-rr  and  proficiency  levels  have  been  identified  as  factors  In 
carrier  landing  accidents.  Pilots  with  low  experience  or  proficiency  levels 
are  more  likoly  to  be  involved  in  carrier  landing  accidents  than  more 
experienced  pilots.  A  high  level  of  pilot  experience  and  proficiency  is 
typically  reflected  in  smoothness  of  aircraft  control.  Infrequent  approach 
deviation'-,  good  ro-'ections  for  deviations  and  responsiveness  to  the  LSO. 
Converse!-  >o-.'  >:/ uerlence  and  proficiency  are  typically  reflected  in 
rojghnc"  •.  i.mcb'.l  itv  of  aircraft  control,  more  frequent  and  extensive 
approach  -!e  *  Uj' .  le  is.  sluggish  or  over-reactive  response  to  deviations 
and  to  the  LSO. 
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Over  time,  a  pilot  builds  a  track  record  of  performance  which  estab¬ 
lishes  him  within  a  skill  level  category.  Being  in  the  high  skill  level 
category  means  that,  typically,  his  behavior  during  approach  is  similar  to 
that  described  above  for  high  experience  and  proficiency  levels.  Low  skill 
level  characteristics  are  similar  to  those  described  for  low  experience  and 
proficiency  levels.  Additionally,  undesireable  pilot  tendencies  are  fre¬ 
quently  associated  with  low  skill  levels.  These  tendencies  vary  greatly 
among  pilots. 

The  condition  of  the  pilot  Is  another  important  factor  In  LSO  perfor¬ 
mance.  A  fatigued  or  disoriented  pilot  will  need  more  assistance  from  the 
LSO  during  approach  Pilot  fatigue  Is  typically  reflected  In  sluggish 
reactions  to  approach  deviations  and  LSO  assistance.  Pilot  disorientation 
is  reflected  In  general ly  unpredictable  reactions  to  deviations  and  LSO 
assistance.  It  may  also  Include  lack  of  response  to  the  LSO  and  reactions 
or  attempted  corrections  in  the  wrong  direction. 


AIRCRAFT  MODEL 

The  aircraft  model  establishes  and  controls  scenario  variances  asso¬ 
ciated  with  the  approaching  aircraft.  Different  types  of  aircraft  have 
different  characteristics.  Characteristics  also  vary  as  a  function  of 
malfunctions,  configuration  and  approach  mode.  Aircraft  fuel  state  Is  also 
a  factor  in  an  approach.  The  aircraft  model  Is  discussed  below  in  two 
separate  segments:  aircraft  type  (characteristics)  and  aircraft  status 
(malfunctions,  configuration,  approach  mode  and  fuel  state). 

AIRCRAFT  TYPE.  There  are  three  types  of  characteristics  of  an  aircraft 
which  are  of  interest  to  the  LSO:  visual,  audio  and  flight  performance 
characteristics.  Each  type  of  aircraft  has  its  own  unique  set  of  charac¬ 
teristics.  Thus,  an  LSO  training  system  needs  a  separate  model  for  each 
type  of  aircraft.  The  types  of  aircraft  which  should  be  considered  for  an 
LSO  training  system  include: 


A- 3 

series 

(EA-3B, 

KA-3B) 

F-4  series 

(RF-4B,  F-4J, 

A-4 

series 

(TA-4J, 

A-4M) 

F-4N, 

F-4S) 

A-6 

series 

(EA-6A, 

KA-6D, 

A-6E) 

F-14A 

A-7 

series 

(A-7B, 

TA-7C, 

A-7E) 

F/A-18 

C-1A 

RF-8G 

C-2A 

T-2C 

E-2 

series 

( E-2B , 

E-2C) 

S-3A 

EA-l 

6B 

VTX 
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With  the  exception  of  F/A-18  and  VTX  (which  are  In  the  future),  all  air¬ 
craft  listed  above  are  currently  operational.  However,  the  RF-8G,  A-7B,  F- 
4N  and  F-4J  may  not  be  appropriate  for  an  ISO  training  system  since  they 
are  likely  to  be  phased  out  of  operations  over  the  next  few  years.  The 
aircraft  which  are  considered  by  this  author  to  be  most  Important  for  an 
LSO  training  system  are: 

A-6E  E-2C  F-4S  F/A-18 

A-7E  EA-6B  F-14A  S-3A 

These  aircraft  are,  or  will  be,  the  most  Drominent  in  Carrier  Air  Wings 
during  the  1980s  and  1990s.  This  mix  also  appears  to  Drovide  an  adequate 
cross-section  of  aircraft  characteristics  needed  to  support  LSO  training 
requirements.  VTX  Is  one  aircraft  that  may  need  to  be  added  to  this  list 
depending  on  perceived  future  needs  for  LSO  training  within  the  Naval  Air 
Training  Command. 


Several  visual  characteristics  are  important  to  LSO  training.  For  day 
recovery  situations,  shape,  size,  perspective  and  engine  exhaust  smcu.e  are 
important  cues.  At  night,  exterior  lighting  is  important.  Since  a  night 
approach  terminates  In  the  white  carrier  deck  lighting,  shape,  size  and 
perspective  are  also  relevant.  For  some  aircraft  the  sound  of  the  engine 
during  approach  Is  a  useful  cue  to  the  LSO. 


Flight  performance  characteristic'  differences  amonq  types  of  aircraft 
are  reflected  in  the  responsiveness  of  aircraft  control  within  the  basic 
dimensions  of  approach  dynamics  (lineup,  glideslope,  AOA).  Lineup  positio¬ 
ning  Is  controlled  by  rate  of  drift  relative  to  the  landing  area  center- 
line.  Drift  is  influenced  by  aircraft  heading,  roll  and  yaw,  and  by  the 
relative  effects  of  wind  and  ship  movement.  Glideslope  positioning  is 
controlled  by  sink  rate  relative  to  the  angular  projection  of  glideslope 
from  the  ideal  touchdown  point.  This  dimension  is  Influenced  by  aircraft 
pitch  and  power,  and  by  the  relative  effects  of  wind  and  ship  movement.  AOA 
is  the  pitch  angle  of  the  aircraft  relative  to  the  flight  path  (relative 
wind)  and  is  controlled  by  coordination  of  pitch  and  power. 

From  an  LSO  training  perspective,  several  aircraft  flight  characteris¬ 
tics  are  of  particular  Interest: 

o  waveoff  capability 

n  acceleration/deceleration  (AOA)  sensitivity  to  pitch  changes 

o  acceleration/deceleration  (AOA)  sensitivity  to  power  setting 

changes 
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o  sink  rate  sensitivity  to  power  setting  changes 

o  sink  rate  sensitivity  to  pitch  changes 

o  sink  rate  sensitivity  to  aircraft  roll  (for  lineup  corrections) 

o  drift  rate  sensitivity  to  lineup  control  Inputs  (roll,  yaw, 

heading  changes) 

o  optimum  approach  speed  range 


Aircraft  capability  to  arrest  sink  rate  with  full  power  and  optimum  AOA 
when  given  a  waveoff  Is  the  most  critical  aircraft  characteristic  to  be 
learned  by  an  LSO.  The  ISO  must  coordinate  this  characteristic  with  range 
from  touchdown,  glldeslope  position  and  other  factors  (wind,  deck  position, 
pilot  skill,  etc.)  as  a  part  of  the  waveoff  decision  process. 


To  provide  amplification,  a  few  examples  are  presented.  The  F-4  and 
A-6  are  aircraft  with  excellent  responsiveness  (sensitivity)  to  power 
Increases  for  arresting  excess  sink  rate  (as  In  a  waveoff  situation).  The 
F-4  aircraft  also  has  high  sink  rate  sensitivity  to  power  reduction  (due  to 
BLC  system).  Aircraft  which  have  low  sink  rate  sensitivity  to  power  in¬ 
creases  are  the  A-7,  F-14  and  S-3  (due  to  slower  engine  windup  time), 
particularly  when  at  very  low  power  settings  (as  when  correcting  for  a 
high  glldeslope  deviation). 


Table  E-7  delineates  many  of  the  performance  characteristics  for 
different  aircraft  types  which  are  of  Interest  to  LSO  training.  This  table 
also  Includes  some  of  the  malfunctions  of  Interest  to  the  LSO. 
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TABLE  E-7.  AIRCRAFT  CHARACTERISTICS 


Good  power  response. 

Frequently  drops  nose*  on  lineup  correction  to  left. 

Occasional  yaw  due  to  assymetric -throttle  control. 

Lineup  a  little  difficult  to  control  due  to  size  and  long  wing  span 
Tendency  to  go  nose  up  on  power  increase,  nose  down  on  power 
decrease. 

Will  bounce  on  nose  down  landing. 

EA-3B  is  faster  than  KA-3B  and  Is  more  sensitive  to  nose 
movement. 

KA-3B  tends  to  decel  mors  than  EA-38. 

Single  engine  *»  power  response  adequate. 


Excellent  lineup  control. 

Good  power  response. 

Tendency  for  hook-skip  bolter  on  nose  down  landing  and  on 
rough  wings  (swinging  hook). 

Good  speed  stability. 

Utility  hydraulic  failure  -  no  flap,  no  speedbrakes. 
Tendency  for  nose  pitch  up  on  waveoff. 

When  cocked-up,  hard  for  pilot  to  see  landing  area. 


Excellent  power  and  waveoff  response,  but  easily  over-controlled. 

Tendency  to  settle  on  late  lineup  corrections. 

Tendency  for  hook-skip  bolter  on  nose  down  landing. 

Lineup  control  difficulties  due  to  pilot  visibility  problems. 

Frequently  shows  rough  wings,  but  not  always  associated  with 
lineup  deviation. 

.Gliding  approach  and  back  on  power  if  speedbrakes  retracted. 

KA-6D  is  a  little  underpowered. 

EA-6A  has  no  speedbrakes,  thus  more  back  on  power  than  A-6E. 

Single  engine  only  &  problem  with  high  gross  weight,  high 
winds,  high  ambient  temperature.  Speedbrakes  in. 

With  single  genera  or  failure,  AOA  Is  only  external  light 
visible. 

With  hydraulic  failure,,  flaps  can  creep  up. 


Slow  engine  response  when  back  on  power. 

Nose  movement  is  common  during  approach. 

AOA  system  and  AOA  indicator  lights  fail  frequently. 
Loss  of  control  augmentat ion  results  in  heavy  controls. 
Loss  of  yaw  augmentations  results  in  yaw  instability. 

No  flap  approach  -  much  faster  and  well  back  on  power. 
Poor  rain  removal  system. 
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Nearly  Instantaneous  power  response. 

On  the  "cut"  signal  takes  "high  dip”  to  land. 

Single  engine  -  faster,  no  flare  on  touchdown;  no  problem. 


Like  E-2,  except  that  when  very  light  tn^re  is  tendency 
to  float  during  approach. 


Excellent  power  and  waveoff  response. 

Lineup  control  difficult. 

61 ides lope  control  very  sensitive  to  nose  movement. 

Tendency  for  hook-skip  bolter  on  nose  down  landing. 

Fuselage  alignment  light  (when  visible)  and  "popping  sound" 
Indicates  need  for  right  rudder. 

Excessive  power  reduction  can  "flatten"  prop 
enough  to  cause  a  rapid  settle. 

Single  engine  -  lineup  control  very  difficult  due  to 
asymmetric  thrust. 

No  flap  approach  -  very  cocked  up. 


Excellent  power  and  waveoff  response. 

Sensitive  nose. 

Tendency  for  hook-skip  bolter  on  nose  down  landing. 
Tendency  to  decel. 

Very  similar  to  A-6E. 


Excellent  power  and  waveoff  response,  but  easily  over¬ 
controlled. 

Stable  AOA  and  nose. 

Very  fast  approach  speed. 

Lineup  control  Is  more  difficult  in  F-4S  model. 

Single  engine  -  half  flaps,  higher  approach  speed,  power 

response  significantly  degraded;  burner  needed  for  waveoff. 

BLC  failure  -  Increased  approach  speed. 

Utility  hydraulic  failure  -  half  flaps. 

Glideslope  control  primarily  with  power,  very  little  nose 
movement. 
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TABLE  E-7.  AIRCRAFT  CHARACTERISTICS  (Continued) 


Slow  engine  response  when  back  on  power. 

Glldeslope  control  -  coordinated  power  and  nose. 

Tendency  to  glide  leading  to  decel,  come  down. 

Tendency  for  hook-skip  bolter  on  nose  down  landing  and 
on  late  lineup  corrections  (swinging  hook). 

Without  DLC  engaged,  back  on  power. 

Single  engine  -  speedbrakes  retracted,  no  problem  except 
that  pilot  must  work  very  hard. 

No  flaps  •  higher  speed,  no  problem. 


Excellent  power  and  waveoff  response. 

Attitude  very  flat  when  on-speed. 

Glldeslope  control  -  coordinated  power  and  nose. 


Excellent  power  and  waveoff  response. 

Glldeslope  control  -  coordinated  power  and  nose. 

Can  get  nose  pitch  up  with  large  power  addition. 
Tendency  to  hook-skip  bolter  on  nose  down  landing  and 
late  lineup  (swinging  hook). 

Single  engine  -  good  power  response. 


Slow  engine  response  when  back  on  power. 

Tendency  to  glide. 

Burble  causes  glldeslope  control  difficulties. 

Lineup  control  difficult,  especially  with  shifting 
wind  conditions. 

Nose  pitch  Is  sensitive  to  power  changes,  especially 
with  DLC  failure. 

No  flap  -  very  fast  and  well  back  on  power. 

Single  engine  -  half  flaps,  lineup  control  difficulties 
due  to  asymmetric  thrust. 

Blue  external  light  to  Indicate  DLC  activation. 
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AIRCRAFT  STATUS.  Aircraft  status  factors  for  ISO  training  situations 
Include  malfunctions,  configuration,  approach  mode  and  fuel  state.  These 
areas  are  discussed  below  and  outlined  in  Table  E-8. 

Aircraft  malfunctions  can  affect  several  aspects  of  an  aircraft  on 
approach.  A  lighting  malfunction  or  a  configuration  variance  (like  half 
flaps)  can  change  the  visual  cueing  provided  to  the  ISO.  Malfunctions  with 
aircraft  subsystems  can  frequently  alter  dynamic  flight  characteristics. 
Engine  failures  (In  twin  engine  aircraft),  flap  malfunctions  and  flight 
control  problems  are  examples.  Malfunctions  associated  with  pilot  instru¬ 
mentation  (such  as  the  AOA  Indicator  and  other  flight  Instruments)  can 
decrease  pilot  control  effectiveness  during  an  approach.  An  aircraft  radio 
failure  degrades  communications  between  the  ollot  and  LSO.  Some  of  the 
likely  malfunctions  to  be  simulated  are  described  below. 

a.  NORDO  (No  Radio)  -  There  are  three  variations  of  aircraft  radio 
malfunction:  pilot  can  receive  but  not  transmit,  pilot  can  transmit  but  not 
receive,  and  pilot  can  neither  transmit  nor  receive.  Approach  situations  In 
which  the  pilot  cannot  receive  radio  transmissions  are  the  most  critical. 
This  degradation  In  pilot/LSO  Interaction  Increases  task  difficulty  for 
both  the  pilot  and  the  LSO. 

b.  Lighting  -  There  are  several  'variances  In  external  aircraft 
lighting  which  Impact  upon  the  LSO  waving  task.  A  loss  of  one  or  more 
external  lights  Increases  LSO  perceptual  difficulty  In  assessing  aircraft 
approach  dynamics  at  night.  Lights  or  sets  of  lights  which  may  malfunction 
Include:  approach  (AOA),  wlngtip,  and  fuselage  lights.  Approach  light 
variation^  include  the  following: 

o  total  failure  (no  lights  visible) 

o  failure  of  a  single  light  (red,  amber  or  green) 

o  single  light  (red,  amber  or  green)  showing  regardless  of 
actual  AOA 

o  Incorrect  light  Indication  relative  to  actual  AOA 

o  day  brightness  setting  (extremely  bright!) 

Wlngtip  light  malfunctions  Include  failure  of  a  single  light  or  concurrent 
failure  of  both  lights..  Fuselage  lighting  varies  significantly  among  dif¬ 
ferent  aircraft  types.  Fuselage  lighting  malfunctions  do  not  have  a  major 
Imoact  upon  the  LSO. 

c.  Engine  -  The  engine  malfunction  of  primary  interest  is  a  single 
engine  failure  for  a  twin  engine  aircraft  (all  types,  except  A-4  and  A-7). 
This  malfunction  changes  flight  characterl sties,  power  response  and.  In 
many  cases,  flap  configuration. 

d.  Landing  Subsystems  -  APCS  malfunctions  include:  sluggish  APCS 
response,  overresponsi ve  APCS,  and  APCS  holding  Incorrect  AOA.  The  DLC 
malfunction  of  note  Is  for  the  system  to  be  Inoperative.  This  affects  the 
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Malfunctions: 


Configuration: 


Approach  Mode: 
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TABLE  E-8.  AIRCRAFT  STATUS 


NORDO 

External  Lighting 

Single  Engine 

APCS 

AFCS 

DLC 

ACLS 

AOA 

Pilot  Instruments 
Hydraulic  Systems 
Flaps 

Launch  Bar 
Speedbrakes 
Wingsweep  ( F-l 4) 
Multiple  falfunctlons 


Normal 

Landing  Gear  Up 
Flaps  (up  or  partial) 

Hook  Up 

Speedbrakes  (wrong  position) 
OLC  (Not  Selected,  F-14) 
Wingsweep  Aft  (F-14) 

External  Stores 
Asymmetric  External  Load 


Manual 
APCS 
ACLS  I 


Bingo  ("Trick  or  Treat") 

Low  (Two  Passes) 

Moderate 

Max  Trap  (Maximum  fuel  allowable  for  landing) 
Excess 


Fuel  State: 
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flight  characteristics  of  the  F-14  by  reducing  normal  approach  power  set¬ 
ting,  thus  aggravating  its  engine  responsiveness  problem  slightly.  For  the 
S-3,  an  inoperative  OLC  reduces  glldeslope  control  effectiveness  and  causes 
nose  control  difficulties  on  power  changes.  ACLS  malfunctions  of  interest 
to  ISO  training  Involve  incorrect/erratic  glideslope  or  lineup  commands 
(leading  to  deviations  during  ACLS  Mode  I  approaches)  and  loss  of  ACLS  Mode 
I  commands  during  approach  due  to  system  failures. 

e.  Flight  Controls  -  Flight  control  malfunctions  primarily  affect 
the  pilot.  In  doing  so,  they  increase  the  LSO  workload  by  typically 
requiring  increased  LSO  assistance.  Some  of  the  malfunctions  include: 
hydraulic  system  problems  affecting  flight  control  effectiveness, 
flap/spoiler  failure,  and  stabilization  augmentation  failure. 

f.  Configuration  -  There  are  several  types  of  malfunctions  involving 
aircraft  configuration  variations.  These  variations  encompass  such  Items  as 
flaps,  ailerons,  spoilers,  wing  sweep  (F-14),  launch  bar,  nose  gear,  and 
speed  brakes. 

g.  Pilot  Instruments  -  Malfunctions  with  several  types  of  pilot 
instruments  can  affect  his  tasking,  thus  impacting  upon  the  LSO  waving  task 
during  approach.  Instruments  of  significance  Include  carrier  approach 
navigational  aids  (TACAN,  needles),  attitude  indicator,  altimeter,  AOA 
indicator,  vertical  speed  indicator  and  HUl). 

Abnormal  aircraft  conf iguratlons  can  be  caused  by  pilot  forgetfulness 
or  can  be  required  for  certain  malfunction  situations.  Variations  in  exter¬ 
nal  stores  (bombs,  missiles,  fuel  tanks)  configuration  may  be  dictated  by 
mission  requirements.  Representation  of  abnormal  configurations  Is  required 
to  teach  the  trainee  to  recognize  them  and  to  help  him  learn  their  effects 
on  LSO  waving  decisions. 

The  mode  of  the  approach  Is  another  aircraft  factor  which  affects  LSO 
performance.  For  an  APCS  approach,  the  LSO  uses  slightly  different  voice 
calls  and  strategies  than  for  a  manual  throttle  approach.  An  ACLS  Mode  I 
approach  Is  computer  controlled  and  the  LSO  must  closely  monitor  the 
approach,  alert  for  control  deviations  and  system  malfunctions. 

Aircraft  fuel  state  is  another  factor.  The  fuel  state  factor  is  re¬ 
lated  to  configuration,  divert  field  distance,  divert  field  weather  and  the 
amount  of  fuel  required  per  approach.  The  fuel  state  segmentations  de¬ 
lineated  in  Table  E-8  are  relative;  actual  fuel  state  for  each  is  a 
function  of  aircraft  type  and  the  factors  mentioned  above.  For  example,  the 
Bingo  fuel  for  an  F-4  may  be  3000  pounds  with  a  close  divert  field  which 
has  clear  weather  conditions.  If  the  divert  field  is  much  farther  away  or 
has  adverse  weather  conditions,  the  Bingo  fuel  state  may  be  much  higher. 
The  real  Impact  of  fuel  state  on  LSO  performance  is  how  many  approaches  are 
available  before  the  aircraft  must  be  diverted  or  refueled  by  the  tanker. 
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OTHER  SITUATION  FACTORS 


This  portion  of  the  Appendix  p re ten  is  information  about  other 
situation  factors  which  are  required  for  ISO  training  scenarios  in  addition 
to  pilot  and  aircraft  f-.ctors.  Groups  of  situation  factors  which  are 
addressed  below  include: 

Environment 
Operations 
ISO  Station 
Ship 

tables  are  also  included  ic  >.h  i  s  subsection  to  delineate  situation 

variables  and  their  value". 

ENVIRONMENT.  There  are  t  1  of  environment*.  conditions  with  which 
the  I.SO  must  contend  dur'ic;  ..<$>-rier  landing  operations.  Environmental 
variables  and  their  values  are  del  1 ne a ted  in  Table  E-9.  Some,  like  deck 
motion,  affect  the  ISO  d i-riv  i.ly  by  compl leaking  his  perceptual  and  decision 
processing.  Others,  like  •,cuid  variations,  primarily  affect  the  pilot/air¬ 
craft  component  of  the  approach,  find  have  sign1ficc.it  influence  upon  the 
resultant  approach  profile  which  must  be  waved  by  the  LSO.  The  three  most 
difficult  environmental  conditions  faced  by  the  LSO  are:  night,  deck 
motion,  and  absence  of  a  defined  horizon.  Part  of  the  task  difficulty  can 
be  attributed  to  the  fact  '.hat  these  conditions  also  increase  pilot  task 
difficulty,  frequently  c us ing  more  erratic  approaches.  One  of  the  most 
significant  effects  or.  id.-;  LSO  is  the  degradation  of  visual  cues  for 
waving.  The  other  is  the  ■  •‘qi •;  cement  to  Integrate  additional  factors  into 
his  decision  processing 

One  of  the  most  sign.  :  ,  aspects  of  deck  motion  is  that  ramp  motif'" 
affects  the  safe  clearance  ■  :-ivi  for  the  terminal  portion  of  an  approach. 
Pitch  and  heave  can  alv  <  ."feet  stabilization  of  the  FLOLS,  givir.g 
erroneous  "meatball"  (glide r;;o  ■  e)  indications  to  the  pilot.  This  can  lead 
to  incorrect  pilot  control  . .  .  i ■••?  to  an  '"earth-stabilized"  glideslope. 
The  motion  degrades  LSO  r*  .  '  ’  :  f  or.  of  optimum  glideslope  and  adds  ramp 
position,  and  the  predictin'  .«?  it,  to  the  decision  process.  Roil  and  yaw 
motion  cause  lineup  control  difficulties  for  the  pilot.  Several  variations 
of  deck  motion,  including  p  i  .  e  h  .  rol  1  ,  y  a  w,  he  a "?  and  their  combinations 
will  be  required  for  LSO  trailing- 

Absence  of  a  defined  horizon  degrades  the  perceptual  performance  of 
the  LSO  by  taking  away  h  1 r.  ear;';  stibil  1  ration  reference  for  glideslope. 
This  is  particularly  criMoai  under  pitching  deck  conditions.  Frequently  a 
plane  guard  destroyer  vMrh  fellow?  the  aircraft  car-ier  can  be  a  substi¬ 
tute  horizon  reference.  c-  i  ••  Tticns  in  pilot  unJ  i  SO  visibility  a3a  in 
. ompl  icate  the  perf ermar  of  each.  The  decrease  in  visibility  may  be 
caused  by  low  ceiling,  ft  n.  ■  i  n .  Ifsiu-T  ly  „  in  these  conditions,  the  ISO 
ren  sec  the  aircraft  h.  v.  •. ;  ,  ' . of  sees  the  sc  .d.  A  ■  isibilitv  condition 
which  precludes  the  L  b.O  f  om  seeing  the  a  i '.'■craft  until  inside  one  half 
mile,  reduces  the  time  t  . :  t.ne  LSO  has  to  monitor  and  evaluate  approach 
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TABLE  E-9.  ENVIRONMENTAL  VARIABLES 


Variable 

Values 

ANIENT  LIGHT 

Day 

Dusk 

Night 

HORIZON 

Clear 

Dim 

None 

DECK  MOTION 

Steady 

Mild  Pitch 

Mild  Roll 

Mild  Yaw 

Moderate  Pitch 

Moderate  Roll 

Moderate  Yaw 

Moderate  Pitch/Roll /Yaw 
Heavy  Pitch 

Heavy  Pitch/Roll /Yaw 

WIND  DIRECTION 

Optimuu 

Axial 

Starboard 

Port 

Shifting 

WIND  VELOCITY 

Optimum 

High 

Very  High 
Low 

Very  low 

VISIBILITY 

Unllml ted 
Fair 

Poor 

Very  Poor 

(7  nmO 
(4-5  nm) 

(2  nm) 
fa  nm) 

CEILING 

None 

Low 

Very  Low 

BURBLE 

None 

Slight 

Significant 
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trends  and  provide  assistance.  Wind  direction  and  intensity  affect  approach 
geometry.  Optimum  wind  is  a  resultant  wind  vector  down  the  angle  deck 
(direction)  of  between  about  20  and  30  knots  (intensity),  depending  on 
aircraft  type.  Deviations  in  direction  influence  lineup  control  by  the 
pilot.  Deviations  in  intensity  affect  ISO  waving  strategies.  For  low  wind 
conditions,  aircraft  approach  speed  may  exceed  arresting  gear  or  aircraft 
structural  limitations. 

OPERATIONS.  There  are  several  operational  situations  and  factors  which 
affect  ISO  performance.  They  are  delineated  In  Table  E-10.  Several  of  these 
place  added  pressure  on  the  LSO  during  the  course  of  waving.  Knowledge  that 
an  aircraft  Is  low  on  fuel  and  there  is  no  airborne  tanker  or  divert  field 
places  a  high  demand  on  the  LSO  to  help  get  the  approaching  aircraft  aboard 
safely.  A  barricade  recovery  Is  another  pressure  situation.  EMCON  condi¬ 
tions  require  the  LSO  to  wave  approaches  without  voice  communications. 
Timely  attention  to  the  status  (clear/foul)  of  the  deck  for  landing  air¬ 
craft  is  a  basic,  but  very  critical,  aspect  of  the  waving  task.  An  out-of¬ 
trim  condition  by  the  ship  can  negatively  affect  the  geometry  and  ramp 
clearance  margins  during  recovery,  increasing  the  vigilance  of  the  LSO  for 
approach  deviations.  Waving  an  approach  while  the  ship  is  turning  is  a 
demanding  task  for  the  LSO. 

Another  important  area  is  the  coordination  among  members  of  the  re¬ 
covery  team  on  the  ship.  On  the  platform  the  controlling  LSO  interacts  with 
a  backup  LSO,  a  phone  talker  and  a  hook  spotter.  He  must  also  interact 
with  PRIFLY  and  CATCC  personnel.  Any  breakdown  in  coordination  or  communi¬ 
cation  among  these  team  members  can  place  added  pressure  and  decision¬ 
making  complexity  on  the  controlling  LSO. 

LSO  STATION.  This  grouping  addresses  the  status  of  LSO  work  station  equip¬ 
ment.  Variations  In  LSO  station  configuration  are  discussed  later  under 
ship  factors. 

Several  LSO  station  indicators  are  frequently  integrated  into  the  LSO 
scan  prior  to  each  approach:  WOD,  FLOLS  (Roll  Angle,  Basic  Angle  and  Hook- 
to-Eye  settings),  ACLS  Mode,  Hook-to  Ramp  and  CLASS  indicators.  Some  pro¬ 
vide  Information  relative  to  aircraft  approach  dynamics:  SPN-42,  SPN-44, 
HUD  and  PLAT.  The  MOVLAS  repeater  provides  MOVLAS  control  movement  feedback 
and  the  Waveoff  light  repeater  enables  the  LSO  to  confirm  the  status  of 
waveoff  liqht  activation.  The  status  of  LSO  controls  (radio,  pickle, 
MOVLAS)  Is  also  relevant  for  LSO  training  situations.  Indicator  and  control 
variables  for  the  LSO  station  are  delineated  in  Table  E-ll. 

SHIP.  There  are  many  variations  among  the  different  aircraft  carriers. 
Size,  shape,  LSO  platform  position  and  resultant  geometrical  relationships 
differ  among  carriers  thus  affecting  the  perspective  of  the  LSO.  Some 
carriers  have  an  LSU  platform  which  is  flush  with  the  flight  deck,  others 
have  a  recessed  platform.  The  configuration  of  the  LSO  work  station  differs 
among  carriers.  Additionally,  a  program  for  modifications  to  the  LSO  work 
station  is  underway.  Some  of  the  LSO  platform  equipment  involved  in  this 
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TABLE  E-10.  OPERATIONS  VARIABLES 


Variables 
AIRBORNE  TANKER 

DIVERT  FIELD 

DIVERT  FIELD  WEATHER 

NO.  OF  AIRCRAFT 

LANDING  INTERVAL 

COWl  RESTRICTIONS 

BARRICADE 
MO  VLAS 
DECK  STATUS 

WIRES  MISSING 


Values 

Yes 

No 

Close 

Far 

None 

VFR 

IFR 

At  Minlmums 

One 

Few 

Some 

Many 

Normal  (Day  45-50  sec..  Night  60-80  sec.) 

Long 

Close 

Very  Close 

None 

Ziplip 

Emcon 

No 

Yes 

No 

Yes 

Closed 

Clear 

Foul 

No  Indication 

None 

Early 

Late 

Target 
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TABLE  E-10.  OPERATIONS  VARIABLES  (Continued) 


Variables 


Values 


CCA  MODE 

ACLS  I 

ACLS  I A 

ACLS  II 

ACLS  III 

Single  Channel  SPN-42 
ASR 

TACAN 

None  (Case  I,  II) 

SHIP  TRIM 

Level 

Stbd  List 

Port  List 

Ramp  up 

Ramp  down 

Combinations 

SHIP  TURN 

No 

Yes 

AMBIENT  NOISE 

Normal 

Quiet 

High 

LENS  STATUS 

Normal 

-  INOP 

Stability  Malfunction 
Other  Malfunction 

PLANE  GUARD  HELO/ 
DESTROYER 


Yes 

NO 


Fleet  Cyclic 
Fleet  CQ/REF 
FRS  CQ 
CNATRA  CQ 


TYPE  OPS 
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TABLE  E-ll.  LSO  STATION  VA I RABIES 


ISO  RADIO 

ROLL  ANGLE 

BASIC  ANGLE 

HOOK/EYE  SETTING 

PLAT 

SPN-42 

SPN-44 

ACLS  MODE  INDICATION 
UOD 

CLASS 

HUD 

PICKLE 

MOVLAS  REPEATER 

WAVEOFF  LIGHT  REPEATER 
MOVLAS  CONTROL 
HOOK-TO-RAMP 


Normal 

INOP 

Wrong  Frequency 

Correct 

Incorrect 

Correct 

Incorrect 

Correct 

Incorrect 

Normal 

INOP 

Normal 

INOP 

Normal 

INOP 

Normal 

INOP 

Normal 

INOP 

Normal 

INOP 

Normal 

INOP 

Partial  Failure 

Normal 

INOP 

Normal 

INOP 

Inaccurate 

Normal 

INOP 

Normal 

INOP 

Normal 

INOP 
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program  Include:  LSO  HUO,  CLASS,  Indicator  Console  and  PLAT.  For  each 
carrier  (or  carrier  class.  In  some  cases)  there  are  differences  In  FLOLS 
geometrical  considerations  for  targeted  touchdown  position.  Arresting  gear 
engaging  speed  limitations  and  other  factors  which  enter  Into  recovery 
decisions  by  the  LSO  also  differ  among  carriers.  Therefore  LSO  training 
situations  may  require  the  representation  of  different  aircraft  carriers. 


MODEL  IMPLEMENTATION  GUIDELINES  AND  CRITERIA 

This  portion  of  the  appendix  addresses  the  implementation  of  the  model 
requirements  presented  earlier.  Initially  the  goals  and  Implementation 
criteria  are  discussed.  Following  that  Is  a  discussion  of  some  guidelines 
for  model  Implementation.  Within  the  discussions  there  are  frequent  refer¬ 
ences  to  the  possible  implementation  of  the  pilot  model  in  the  LSO  Reverse 
Display.  Such  an  option  has  the  potential  of  Increasing  Its  effectiveness 
through  the  application  of  a  limited  aspect  of  the  automated  LSO  training 
system  concept. 

IMPLEMENTATION  GOALS.  The  ultimate  goal  of  training  system  performance  Is 
that  It  provide  a  high  transfer  of  training  for  LSO  waving  skills.  In 
support  „f  this,  the  primary  goal  In  model  Implementation  is  that  the 
operation  of  models  be  responsive  to  LSO  training  needs.  Based  on  analyses 
conducted  during  this  "study,  tWe  mosT important  LSO  training  needs  are 
reduction  in  the  time  required  to  complete  LSO  training  and  increased 
trainee  exercise  of  critical  decision  skills. 

Reduction  In  training  time  is  likely  If  the  LSO  training  system  can 
provide  additional  waving  experience  to  the  trainee  and  effective  feedback 
on  waving  performance.  It  would  be  desirable  that  the  waving  experience 
provided  to  the  trainee  encompass  all  situations  likely  to  be  encountered 
on  the  job.  However,  this  goal  may  be  achievable  with  a  limited  set  of 
waving  situations  which  provide  a  strong  foundation  of  basic  decision 
skills  and  cognitive  schema  for  expansion  of  these  skills  on  the  job. 
Instruction  which  allows  a  trainee  to  walk  aboard  ship  and  Immediately  take 
on  unsupervised  waving  duties  Is  not  a  realistic  goal  for  an  LSO  training 
system. 

The  basic  perceptual  skills  are  rapidly  acquired  on  the  job.  However, 
trainee  Interaction  with  the  pilot  is  an  initial  stumbling  block  during  on- 
the-job  training.  Thus,  effective  simulation  to  support  this  interactive 
training-tar1',  must  receive  very  high-priority  as  a  part  of  the  goal  to 
reduce  on-the-job  training  time. 

The  waveoff  decision  skill  must  receive  highest  priority  if  the  system 
Is  to  provide  effective  trainee  preparation  for  on-the-job  training.  Use 
of  the  training  s>stem  must  provide  a  foundation  of  cognitive  skills  from 
which  to  learn  how  to  handle  Increasingly  complex  and  stressful  waveoff 
decision  situations.  On-the-job  there  are  relatively  few  opportunities  for 
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the  trainee  to  actively  exercise  waveoff  decision  skills.  An  LSO  training 
system  can  provide  opportunities  to  Interactively  explore  the  influences  on 
the  waveoff  decision  without  jeopardizing  carrier  landing  safety. 

It  is  apparent  to  the  authors  that  LSOs  have  difficulty  In  verbalizing 
and  quantifying  the  tasks  they  perform  while  waving  approaches.  This  has 
reduced  the  efficiency  of  the  performance  feedback  process  between  LSO 
teacher  and  trainee.  An  LSO  training  system  can  increase  the  efficiency  of 
task  performance  feedback  through  performance  measurement,  task  replay  and 
other  Instructlonally  oriented  capabilities.  These  capabilities  are  there¬ 
fore  likely  to  provide  the  trainee  with  better  Insight  to  the  waving  tasks 
through  objective  performance  assessment  and  to  better  equip  him  to  be  an 
active  learner  on  the  job.  In  view  of  these  considerations,  the  learning 
process  should  be  accelerated. 

Another  consideration  In  achieving  the  goal  of  responsiveness  to 
training  needs  Is  flexibility  of  model  Implementation.  The  pilot  behaviors 
and  aircraft  performance  being  simulated  must  be  Implemented  such  that 
model  parameters  can  be  easily  modified  based  on  Initial  testing,  as  well 
as  on  feedback  from  operational  use.  The  aircraft  simulation  must  also  be 
Implemented  to  allow  for  future  Inclusion  of  different  types  of  aircraft. 
The  communications  between  Instructor  model  and  pilot/aircraft  models  must 
be  Implemented  such  that  the  Interface  can  be  refined  and/or  revised  baser 
on  changing  training  requirements. 

The  LSO  Reverse  Display  already  has  some  of  the  capabilities  desired 
for  an  automated  LSO  training  system.  Implementation  of  the  pilot  model 
requirements  described  In  this  appendix  would  reduce  the  need  for  pilot 
personnel  In  LSO  Reverse  Display  utilization  for  LSO  training.  It  may  also 
enable  trainee  practice  sessions  without  the  presence  of  an  ir.s  '•uctor  LSO 
However,  the  training  effectiveness  of  this  latter  notion  has  not  been 
confirmed. 

The  above  discussions  have  addressed  system  and  model  Implementation 
considerations  relative  to  LSO  training  system  performance  goals.  The  next 
discussion  addresses  Implementation  criteria  for  pilot/aircraft  models  in 
support  of  these  goals. 

IMPLEMENTATION  CRITERIA.  The  primary  criterion  for  model  implementation  is 
face  validity  of  the  pilot  behavior,  aircraft  performance  characteristics 
and  other  conditions  simulated,  relative  to  the  training  goals  of  the 
system.  The  criteria  for  face  validity  are  addressed  below  from  two  per¬ 
spectives.  The  first  perspective  Is  that  of  minimum  simulation  require¬ 
ments  for  an  LSO  training  system.  The  other  Is  the  performance  quality  of 
pilot  and  aircraft  simulations. 

As  mentioned  earlier.  It  would  be  desirable  to  simulate  all  wavinq 
conditions  and  situations  which  the  trainee  may  encounter  on  the  job. 
However,  In  view  of  potential  funding  constraints,  technological  limita¬ 
tions  and  limited  training  time  available,  this  may  be  unachievable.  Thus, 
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a  realistic  goal  for  the  training  system  would  be  to  provide  the  trainee 
with  waving  experience  and  performance  feedback  for  situations  which  exer¬ 
cise  the  most  critical  decision  skills  required  for  the  job.  To  achieve 
this  goal,  the  waving  situations  used  in  training  must  include  the  condi¬ 
tions  and  decision  factors  which  have  been  Identified  as  most  critical  to 
successful  waving  performance. 

During  this  study  It  was  evident  from  many  Information  sources  that 
the  waveoff  decision  Is  the  most  important  aspect  of  successful  waving 
performance.  It  was  also  apparent  that  the  most  Important  situation  factor 
affecting  the  waveoff  and  other  decisions  Is  the  behavior  of  the  pilot 
during  approach.  Thus,  a  primary  criterion  of  Implementation  is  to  provide 
meaningful  simulation  for  LSO  and  pilot  interaction  during  approach.  For 
the  simulation  to  be  meaningful.  It  must  very  closely  replicate  the  time 
criticalities  of  pilot  behavior  found  in  on-the-job  waving  decisions,  which 
will  be  discussed  in  more  detail  later.  Pilot  behavior  must  be  represented 
from  two  aspects;  approach  profile  control,  and  response  to  LSO  calls/ 
signals.  Pilot  behavior  must  also  be  represented  in  conjunction  with  at 
least  three  types  of  aircraft  In  order  for  the  trainee  to  experience  a 
variety  of  example  decision  situations.  The  aircraft  types  should  have 
dissimilar  performance  characteristics.  The  F-14  Is  suggested  as  one  type 
since  it  represents:  large  aircraft,  relatively  slow  approach  speed, 
variety  of  approach  modes  (APC,  DLC,  manual  throttles),  and  relatively 
difficult  lineup  control.  The  A-7  is  suggested  as  another  as  it  Is  repre¬ 
sentative  of:  small  aircraft,  relatively  fast  approach  speed,  relatively 
easy  lineup  control.  Since  both  have  sluggish  power  response  following 
power  reductions,  either  the  A-6  or  E-2  Is  suggested  as  the  third  type, 
which  would  be  representative  of  excellent  pewer  response.  Besides  provi¬ 
ding  a  representative  cross-section  of  aircraft  performance  character¬ 
istics,  these  aircraft  also  allow  the  presentation  of  typical  multi¬ 
aircraft  carrier  recovery  scenarios. 

Four  environmental  conditions  are  considered  to  be  minimum  require¬ 
ments  for  Implementation  within  the  simulation:  night,  deck  motion,  wind 
variations,  and  horizon  definition  variations.  Night  is  the  most  difficult 
environment  for  both  the  pilot  and  LSO,  and  Is  the  condition  under  which 
most  accidents  occur.  Deck  motion  and  wind  variations  are  critical  factors 
In  carrier  landing  accidents.  Providing  these  conditions  and  variations  In 
horizon  definition  will  enable  the  trainee  to  exercise  his  waving  skills 
under  a  wide  variety  of  example  situations.  For  an  LSO  Reverse  Display 
application,  these  conditions  are  already  Incorporated. 

The  final  minimum  requirement  for  an  LSO  training  system  Is  the  provi¬ 
sion  for  using  the  MOVLAS.  Although  MOVLAS  does  not  appear  very  frequently 
as  an  accident  factor.  It  Is  a  critical  LSO  skill  for  which  there  are  few 
opportunities  for  practice  In  the  operational  environment.  The  LSO  Reverse 
Display  already  Includes  provisions  for  MOVLAS. 

The  quality  of  pilot  behavior  and  aircraft  performance  simulations 
will  be  extremely  Important  to  training  system  effectiveness.  The  pilot 
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behavior  simulation  must  very  closely  replicate  actual  control  of  approach 
parameters,  particularly  during  the  final  half  mile  of  the  approach.  This 
Is  also  true  In  the  case  of  the  aircraft  model.  The  dynamics  of  the  pilot 
and  aircraft  working  together  provide  the  primary  decision  cues  for  ISO 
actions.  The  approach  profile  control  component  of  the  pilot  model  con¬ 
trols  the  dynamic  cues  which  precede  and  are  Independent  of  LSO  Interven¬ 
tion.  The  response  component  of  the  pilot  model  controls  the  dynamic  cues 
which  result  from  LSO  Intervention  In  the  approach.  The  primary  dynamic 
cues  under  the  control  of  these  model  components  are  rate  of  descent, 
lineup  drift,  AOA.  Representation  of  rate  of  descent  and  AOA,  must  be 
based  on  realistic  control  of  engine  power  and  pitch.  During  implementa¬ 
tion,  the  realism  of  control  for  these  approaches  must  be  thoroughly  tested 
and  evaluated  by  expert  LSOs  to  assure  face  validity  of  the  simulation  of 
pilot  and  aircraft. 

A  consideration  for  partial  pilot  model  Implementation  in  the  LSO 
Reverse  Display  would  be  use  of  existing  Mode  I  ACLS  software  to  control 
the  approaches.  Additional  software  could  be  added  to  tell  the  ACLS  soft¬ 
ware  where  to  fly  the  aircraft  (l.e.,  go  very  high  In  the  middle,  go  a 
little  low  In  close,  etc.).  This  Is  called  a  partial  implementation  since 
the  ACLS  does  not  control  AOA. 

OTHER  IMPLEMENTATION  CONSIDERATIONS.  The  guidelines  presented  below 
suggest  some  of  the  near-term  considerations  and  activities  for  Implementa¬ 
tion  of  the  models.  They  are  applicable  both  to  an  LSO  Reverse  Display 
retrofit  and  a  new  procurement. 

Near  tern  ementation  activities  must  include  Involvement  by  system 
Eiialysts,  sof";  t  programmers,  training  analysts  and  LSO  subject  matter 
experts.  This  *  i>  of  expertise  Is  required  to  complete  the  detailed  design 
of  the  models  and  to  ease  transition  from  functional  requirements  to  soft¬ 
ware  and  hardware  reality  without  jeopardizing  the  training  requirements 
orientation  of  system  development.  Subject  matter  and  systems  analysis 
expertise  must  be  applied  to  the  detailed  derivation  of  specific  model 
parameters  and  values,  and  to  the  development  of  appropriate  algorithms 
based  on  requirements  described  earlier  In  this  appendix.  Training 
analysis,  subject  matter  and  systems  analysis  expertise  must  be  applied  to 
the  detailed  design  of  the  Interactions  between  the  simulation  (pilot  and 
aircraft  models)  and  Instructional  control  (Instructor  model)  aspects  of 
the  training  system.  Training  analysis  and  subject  matter  expert  personnel 
must  be  Involved  In  the  testing  of  model  validity  and  overall  system  opera¬ 
tion  to  Insure  that  system  capabilities  adhere  to  the  training  requirements 
on  which  it  is  based. 

In  the  derivation  of  specific  model  parameters  and  values,  the  LSO 
Reverse  Display  Is  suggested  as  a  potentially  useful  tool.  Approaches 
flown  from  the  NCLT  could  be  recorded  and  parameters  analyzed  to  establish 
values  for  the  variations  needed  In  training  scenarios. 
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A  major  concern  for  the  automated  LSO  training  system  concept  Is  the 
performance  of  speech  recognition  technology.  Its  feasibility  In  providing 
realistic  representation  of  pilot  responses  must  be  evaluated  as  early  as 
possible  during  Implementation  of  the  models.  Additionaly,  there  should  be 
early  design  attention  to  alternative  control  schemes  such  as  trainee 
interaction  strictly  through  the  waveoff  and  cut  light  controls  and  provi¬ 
sions  for  "joystick"  type  responses  activated  by  an  Instructor.  These 
considerations  would  be  particularly  relevant  If  the  pilot  model  was  to  be 
implemented  with  the  LSO  Reverse  Display. 

A  final  consideration  Is  the  availability  of  Information  and  data 
which  are  relevant  to  model  implementation.  Besides  this  report,  there  are 
several  others  listed  In  the  bibliography  which  are  valuable  references  for 
various  aspects  of  model  Implementation.  Additionally,  the  Naval  Safety 
Center  is  a  source  of  data  specific  to  carrier  landing  accidents.  Useful 
reports  and  other  sources  of  data  are  listed  In  Table  E- 12.  The  table  also 
includes  coded  categories  for  the  types  of  Information  available  in  each. 
Refer  to  the  References  and  Bibliography  for  additional  identifying  details 
for  the  reports  listed. 
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TABLE  E-12.  SOURCES  OF  IMPLEMENTATION  INFORMATION 


Source 

Borden,  1969 
Breaux,  1980 

Brlctson,  et  al.,  1980  (2  reports) 
Chatfleld,  et  al ,  1979 
Erickson,  1978 
Hooks,  et  al.,  1978 
Hooks,  et  al.,  1980 
Hooks  and  McCauley,  1980 
LSO  School  (course  Materials) 
McCauley  and  Borden,  1980 
McCauley  and  Semple,  1980 
McCauley  and  Cotton,  1981 
Nave,  1974 
Naval  Safety  Center 
(Accident  Reports) 

Netherland,  1965 
Relgle  and  Smith,  1973 
Smith,  1973  (2  reports) 

U.S.  Navy,  1975 
U.S.  Navy,  1976 
Van  Hemel ,  et  al . ,  1980 
Vought  Corp.  1977 


Type  of  Information 
A,  6 

A.  D,  E,  G 
A,  B,  C 
D,  G 
A,  B 
A,  B,  D 

C.  D,  F 
0,  E,  F 
A,  B 

A,  B,  C,  D 
G 

D.  G 
C,  F 

E.  G 

A,  B,  C 
F 

C,  F 
A 

A,  B,  D 

G 

E 


Type  Information  Codes: 

A  «  LSO  Job  and  Training 

B  -  Carrier  Landing  Situations/Factors 

C  ■  Pilot  Behavior 

0  ■  LSO  Training  System 

E  ■  LSO  Reverse  Display 

F  ■  Carrier  Recovery  Simulation 

G  »  Automated  Speech  Recognition 
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APPENDIX  F 
FUNCTIONAL  DESIGN 

1.0  INTRODUCTION 

This  appendix  is  the  final  of  two  primary  products  produced  in  the 
course  of  this  project  (the  preceding  appendix  being  the  other).  The 
project  involved  a  series  of  analytical  studies  to  identify  critical 
aspects  of  the  LSO  waving  task  upon  which  to  base  the  functional  charac¬ 
teristics  of  pilot  and  aircraft  models  within  LSO  training  systems.  Appen¬ 
dix  E  addresses  the  functional  characteristics  of  pilot  and  aircraft  be¬ 
havior  models  which  are  needed  to  support  interactive  LSO  training. 
Appendix  F  addresses  the  overall  functional  design  context  for  an  LSO 
Training  System  within  which  the  pilot  and  aircraft  behavior  models  are 
intended  to  operate.  System  developers  must  refer  to  both  appendices  (E 
and  F)  during  detailed  design  and  implementation.  Developers  must  also 
refer  to  similar  products  developed  in  a  companion  project  devoted  to 
automated  instructor  model  functions  for  LSO  Training  Systems. FI 

1.1  PURPOSE 

This  appendix  describes  the  plan  for  the  definition,  design,  develop¬ 
ment,  and  implementation  of  the  software  for  the  Simulation  Subsystem 
portion  of  the  Landing  Signal  Officer  Training  System  (LSOTS)  during 
detailed  design.  It  should  be  used  In  conjunction  with  Appendix  E,  which 
provides  detailed  descriptions  of  the  pilot/aircraft  modelling  requirements 
for  the  Simulation  Subsystem.  This  functional  design  provides  a  descrip¬ 
tion  of  the  main  characteristics  of  the  software,  placed  in  context  with 
the  purpose,  design,  and  operational  concept  of  the  overall  training 
system.  The  section  on  Program  Design  addresses  the  functional  and  opera¬ 
tional  considerations  of  the  software  and  describes  simulation  subsystem 
modules.  Training  and  system  constraints  are  also  discussed. 

1.2  DESIGN 

The  LSO  training  program  requires  a  medium  which  can  provide  inter¬ 
active  trainee  task  performance  situations  within  the  context  of  instruc¬ 
tional  guidance.  This  is  currently  being  accomplished  In  the  job  environ¬ 
ment  of  field  and  carrier  landing  operations  under  the  guidance  of 
supervisory  LSOs.  However,  this  dependency  upon  the  OJT  environment  has 
become  unacceptable  due  to  frequent  extended  periods  of  reduced  levels  of 
operations  and  shortages  of  skilled  LSOs.  To  supplement  the  OJT  environ¬ 
ment,  an  automated  LSO  training  concept  has  been  conceived  and  researched 
by  the  Navy.  Some  aspects  of  the  concept  have  been  exercised  in  the 
laboratory  and  in  the  field,  and  are  discussed  earlier  In  the  report  In 
Section  III. 

F1  McCauley,  Michael  E.  and  Cotton,  John  C.,  Automated  Instructor 
Models  for  LSO  Training  Systems.  Technical  Report  RAVTRAEQUIPCEN  80-C-0073- 
T.  Naval  Training  Equipment  Center,  Orlando,  Florida,  1982. 
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The  design  concept  of  an  automated  LSO  training  system  Is  based  on 
several  required  functional  characteristics.  It  must  provide  visual  simu¬ 
lation  of  the  carrier  landing  environment  from  the  LSO  workstation  perspec¬ 
tive.  It  must  provide  the  means  for  LSO  task  interactions  with  the  pilot 
during  the  landing  process.  It  must  be  independent  of  other  training 
devices.  It  must  provide  automated  support  for  Instructional  guidance, 
syllabus  control,  trainee  evaluation  In  the  learning  process,  and  recording 
of  trainee  progress  In  the  training  program. 

This  design  concept  can  be  slmpl Istlcally  represented  by  five  major 
system  elements: 

o  Trainee  Station 
o  Instructor  Console 
o  Instructor  Subsystem 
o  Simulation  Subsystem 
o  Trainee  Performance  Records 

These  elements  and  their  Interrelationships  are  slmpl istlcally  depicted  In 
Figure  F-l. 


The  pllot/alrcraft  behavior  model  requirements  will  be  Implemented 
within  the  Simulation  Subsystem.  Requirements  for  the  pilot  model  are 
described  in  Appendix  E  and  Include  approach  profile  control  and  dynamic 
response  to  LSO  voice  calls/signals  during  approach.  The  purpose  of 
approach  profile  control  Is  to  depict  various  deviations  and  trends  In 
gildeslope,  lineup,  and  AOA  for  LSO  perceptual  and  decision  skill  acquisi¬ 
tion.  The  purpose  of  dynamic  response  to  the  LSO  Is  to  present  variations 
In  pilot  responsiveness  which  must  be  learned  by  the  LSO  trainee.  Require¬ 
ments  from  the  aircraft  model  Include  variations  In  aircraft  type,  aircraft 
malfunctions,  and  other  approach  characteristics  (mode,  configuration,  and 
fuel  state). 


There  are  three  technological  areas  which  are  important  to  the 
automated  LSO  training  system,  and  consequently  to  the  pilot/alrcraf t 
behavior  models  functions.  The  effectiveness  of  pllot/alrcraft  model  out¬ 
put  Is  somewhat  dependent  upon  the  quality  of  visual  simulation  to  portray 
the  required  dynamic  cues.  Another  Is  automated  speech  recognition  (and 
understanding).  This  technology  will  be  important  to  effective  represen¬ 
tation  of  pilot  responses  to  LSO  voice  calls  and  to  automated  performance 
measurement.  The  third  technological  area  is  the  automated  "Intelligence" 
associated  with  syllabus  control.  This  affects  the  quality  of  decisions 
made  (human  or  automated  Instructor)  regarding  pilot  and  aircraft  behavior 
selections  for  training  situations.  The  technological  aspects  of  system 
design  and  their  functional  Implications  are  addressed  later  In  more 
detail. 
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Figure  F-1.  LSO  Training  System  Concept 
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1.3  OPERATIONAL  CONCEPT 

An  LSO  training  system  will  be  one  Instructional  component  within  the 
overall  LSO  training  program.  Other  methods  and  media  employed  within  this 
integrated  training  program  will  Include  academics,  field  carrier  landing 
practice  (FCLP)  operations  and  actual  carrier  landing  operations. 

The  operational  concept  of  an  automated  LSO  training  system  Is  to 
provide  Instructional  support  for  a  variety  of  LSO  training  requirements, 
from  basic  through  advanced  skills.  Basic  skill  areas  include  perception 
of  aircraft  approach  dynamic  cues,  correlation  of  cues  to  appropriate  LSO 
actions,  and  LSO  workstation  habit  patterns.  Intermediate  skill  areas 
Include  the  formulation  of  aircraft  control  (“waving")  strategies  for  a 
variety  of  aircraft  types  and  pilot  characteristics.  Adva.-ced  skill  areas 
Include  the  extension  of  basic  and  Intermediate  skills  Into  complex 
recovery  situations.  These  situations  Include:  aircraft  mal functions, 
difficult  environmental  conditions  (deck  motion,  low  visibility,  non-- 
optlmum  wind,  etc.)  and  difficult  operational  conditions  (low  fuel  state 
aircraft,  arresting  wires  missing,  mistrlm  of  ship,  malfunctions  of 
workstation  aids,  etc.).  In  addition  to  aircraft  control  skills,  the 
trainee  must  learn  to  make  decisions  associated  with  safety  and  efficiency 
of  the  overall  recovery  process.  Throughout  the  training  program  the 
trainee  will  be  learning  Increasingly  complex  concepts  and  relationships. 
The  automated  LSO  training  system  concept  also  encompasses  refresher 
training  for  LSOs  following  extended  absences  from  LSO  duties. 

The  training  In  an  automated  LSO  training  system  will  Involve  the 
presentation  of  Interactive,  simulated  carrier  landing  situations  to  the 
LSO  trainee.  The  trainee  will  observe  an  approaching  aircraft  and  initiate 
voice  calls  or  light  signals  based  on  aircraft  dynamics  in  conjunction  with 
other  conditions  existing  In  the  simulated  carrier  landing  situation,  such 
as  deck  motion,  wind,  aircraft  malfunctions,  etc.  Pilot  reactions  to 
trainee  voice  calls  and  signals  will  also  be  Included  In  the  simulated 
carrier  landing  situations.  Situations  will  also  be  presented  which  demand 
that  the  trainee  make  decisions  regarding  management  of  the  recovery 

frocess  (such  as  rigging  the  MOVLAS  and  changing  the  target  wire), 
nstructlon  regarding  what  Is  to  be  learned  In  training  sessions  will  also 
be  provided  In  the  form  of  task  descriptions,  explanations  and  demonstra¬ 
tions.  In  conjunction  with  the  interactive  recovery  situations,  the 
trainee  will  also  be  provided  with  feedback  regarding  the  quality  of  his 
performance. 

Progression  by  the  trainee  through  the  training  program  will  be  based 
upon  a  combination  of  human  Instructor  decisions  and  automated  syllabus 
recommendations  generated  by  the  Instructor  subsystem.  The  system  will 
also  have  provisions  for  trainee  selection  of  practice  exercises.  A  goal 
of  the  system  Is  to  minimize  the  loading  on  the  human  Instructor  and  to 
reduce  the  need  for  human  Instructor  presence  during  training.  As  exper¬ 
ience  Is  gained  in  the  use  of  the  system,  It  Is  anticipated  that  the 
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automated  Instructor  decision  logic  will  be  refined  to  enable  a  significant 
amount  of  effective  "Instructor-absent"  training. 

The  pilot/aircraft  behavior  models  play  an  Important  functional  role 
within  the  system.  They  guide  the  representation  of  pilot  and  aircraft 
behavior  In  the  simulated  carrier  lanalng  environment.  The  variations  of 
behavior  presented  are  based  on  deliberate  guidance  from  instructional 
objectives.  This  guidance  comes  from  an  instructor  (human  or  automated) 
component  of  the  system.  Pilot  behavior  will  be  represented  In  variations 
of  the  approach  profiles  being  observed  by  the  LSO.  It  will  also  be 
represented  In  variations  of  how  the  pilot  responds  to  calls  and  signals 
from  the  LSO.  Aircraft  behavior  and  appearance  will  vary  by  type  of  air¬ 
craft  and  aircraft  system  malfunctions.  An  overview  of  models  interaction 
presented  earlier  In  Appendix  E  is  repeated  here  In  Figure  F-2. 

1.4  SOFTWARE 

The  LSO  Training  System  and  Its  applications  software  are  being 
designed  based  on  the  following  goals  and  assumptions: 

o  Top  Down,  Structured  Design.  The  LSO  Training  System  should  be 
designed  using  a  top-down,  structured  approach.  This  method 
Involves  defining  the  system  In  terms  of  functions  provided  at 
the  highest  possible  logical  level.  The  function  Interfaces  are 
described  while  Implementation  details  are  assumed  to  be  defined 
and  available  at  the  next  lower  level  In  a  functional  form.  The 
process  Is  repeated  recursively  at  successively  lower  levels 
until  all  functional  and  procedural  details  have  been  Identified. 
This  occurs  at  the  lowest  level.  In  this  way  the  exact  jJeta i  1  s 
are  left  to  be  Identified  and  solved  only  when  the  highest  levels 
have  been  completed.  This  process  has  been  proven  to  signifi¬ 
cantly  Improve  design  characteristics  and  reduce  development  time 
In  both  large  and  small  software  projects. 

o  Modular  Design.  All  LSO  Training  System  software  should  be 
designed  around  the  concept  of  modularity.  This  Involves  parti¬ 
tioning  the  Identified  functions  Into  separate  software  entitles 
called  modules.  These  modules  are  either  Internal  procedures  or 
external  procedures.  The  use  of  external  procedures  In  LSO 
Training  System  software  is  being  emphasized  as  this  results  In  a 
system  that  Is  easier  to  design.  Implement,  debug,  and  maintain. 

o  System  Connectivity.  The  concept  of  strongly  versus  weakly  con¬ 
nected  systems  has  long  been  a  software  design  controversy.  A 
strongly  connected  system  Is  one  that  relies  heavily  on  the  use 
of  shared  memory  variables  to  pass  control  Information  and  data 
between  modules.  A  weakly  connected  system  uses  parameters  and 
variables  that  are  "passed"  between  the  modules  needed  to  refer¬ 
ence  them.  The  LSO  Training  System  should  be  designed  as  a 
weakly  connected  message  driven  system. 
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o  Data  Driven.  The  LSO  Training  System  software  should  be  designed 
as  a  data  driven  system  where  all  the  input  parameters,  data  and 
constants,  and  the  majority  of  the  control  and  decision  logic  are 
defined  externally  to  the  program  in  system  resident  disk  files. 
This  means  that  the  execution  and  nature  of  the  program  depends 
solely  on  the  data  it  uses.  This  approach  allows  one  set  of 
programs  to  serve  many  purposes,  each  of  which  Is  defined  by  a 
new  set  of  parameters  and  data  contained  in  user  selectable  disk 
files. 

o  System  Flexibility.  Software  design  must  also  be  flexible  enough 
to  be  responsive  to  future  system  refinements  and  change  require¬ 
ments.  Visual  simulation  changes  may  eventually  be  needed  for 
such  items  as  new  fleet  aircraft,  major  modifications  of  existing 
aircraft,  additional  aircraft  carriers  and  modifications  to  the 
LSO  platform.  The  training  tasks  may  change  with  the  addition 
and  deletion  of  acceptable  LSO  voice  calls.  As  more  is  learned 
about  correct  LSO  behavior,  the  performance  measures  and  evalua¬ 
tion  criteria  may  have  to  be  modified.  Discovery  of  new  instruc¬ 
tional  techniques  may  require  modifications  to  the  graphic 
effects  and  display  formats  used  for  instruction  and  feedback. 

o  Training  Goal  Orientation.  The  LSO  training  system  has  not  been 
conceived  as  merely  a  vehicle  for  practice  of  waving  tasks.  It 
has  been  conceived  as  a  system  In  which  training  sessions  and 
specific  exercises  are  to  be  based  upon  definitive  LSO  perfor¬ 
mance  and  training  goals.  Within  the  training  system,  the 
performance  goals  and  the  logic  for  presentation  of  related  in¬ 
structional  situations  must  be  under  the  control  of  the  instruc¬ 
tor  subsystem.  This  does  not  preclude  trainee  and  human  instruc¬ 
tor  intervention  In  the  training  process.  It  does  insure  that 
system  users  are  made  aware  of  training  goals  in  order  to 
minimize  inappropriate  uses  of  the  system.  If  the  resident 
performance  goals,  course  of  instruction,  syllabus  logic  or  other 
aspects  of  the  system  are  found  to  be  deficient,  change  require¬ 
ments  should  be  verified  and  the  system  modified. 


Using  the  above  goals  and  assumptions  will  allow  portions  of  the 
systeir  to  be  concurrently  developed  by  separate  groups  and  still  maintain  a 
complete  and  integrated  design  of  the  system  as  a  whole.  The  remainder  of 
this  document  addresses  the  LSO  Training  System  in  general  and  the  Simula¬ 
tion  areas  in  particular.  Other  areas  are  discussed  as  needed. 
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2.0  PROGRAM  DESIGN 

The  ISO  Training  System  applications  software  Is  being  designed  to 
provide  the  programs,  modules,  and  functions  needed  to  fulfill  the  training 
requirements  and  operational  system  requirements  within  the  system  con¬ 
straints.  The  software  must  be  capable  of  the  following: 

o  Interacting  with  Instructors  and  trainees  and  curriculum  design 
personnel ; 

o  controlling  the  access  to  and  manipulation  of  large  and  complex 
data  bases  associated  with  general  and  specific  training  applica¬ 
tions  and  situations  (syllabus,  visual  simulation,  training 
records) ; 

o  simulating  the  action  of  sophisticated  hardware  systems  (air¬ 
craft); 

o  simulating  the  human  decision  making  process  (LSO,  pilot); 

o  monitoring  and  directing  the  activity  of  a  system  whose  parts  may 

be  partially  external  to  Itself; 

o  provide  off-line  support  for  the  above  functions. 


The  LSO  Training  System  hardware  Is  assumed  to  consist  of  one  or  more 
central  processor  units  (CPUs),  random  access  memory,  disk  storage,  a 
display  subsystem,  a  speech  subsystem,  and  various  general  purpose  Inter¬ 
faces.  The  system  hardware  Is  not  known  at  this  time,  but  It  Is  assumed 
that  when  the  selection  Is  made  the  hardware  will  provide  the  basic 
subsystems  and  capabilities  assumed  in  the  design. 

2.1  PROGRAM  CONTROL 

The  LSO  Training  System  Is  a  computer  based  training  system.  The 
functional  organization  of  the  system  Is  described  below.  Overall  system 
functional  areas  consist  of  the  following: 

o  Syllabus  Control.  The  Syllabus  Control  function  embodies  all  the 
capabilities  associated  with  an  Instructor  Model:  Syllabus 
Decisions,  Performance  Monitoring,  Performance  Evaluation, 
Student  Records  and  the  man-machine  Interface. 

o  Exercise  Control.  The  Exercise  Control  function  consists  of 
Scenario  Control,  Scenario  Generation,  Task  Monitoring,  and 
processing  associated  with  speech  understanding  Inputs  generated 
by  the  trainee. 
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o  Exercise  Presentation.  The  Exercise  Presentation  function 
Includes  all  non-instructor  modeling  and  simulation  routines,  and 
the  display  of  exercise  or  task  related  data  and  cues. 

o  Data  Management.  The  Data  Management  function  controls  access  to 
and  maintenance  of  all  Information  used  In  the  LSO  Training 
System.  This  includes  student  records,  simulation  data,  display 
data,  syllabus  data,  speech  data,  and  task  related  data. 

It  must  be  remembered  that  these  functional  groupings  in  no  way  depict 
their  logical  interrelationships.  Figure  F-3  shows  the  functional  areas 
partitioned  into  subsystems.  Here  the  relationships  of  the  functions  to 
their  logical  and  physical  interaction  are  more  apparent. 

The  Instructor  Subsystem  contains  the  functions  responsible  for  sylla¬ 
bus  selection,  syllabus  control,  performance  monitoring,  performance 
evaluation,  system  summary,  and  the  access  and  control  of  student  records, 
speech  data,  and  some  task  related  data.  The  design  of  this  subsystem  must 
also  include  the  man-machine  interface  for  the  LSO  Training  System  as  a 
whole.  The  Instructor  Subsystem  interacts  with  all  the  remaining  sub¬ 
systems. 

The  Simulation  Subsystem  implements  the  functions  of  scenario  genera¬ 
tion,  scenario  monitoring,  scenario  control,  all  non- 1 nstructor  related 
modeling  and  simulation,  acting  on  speech  understanding  (SUS)  inputs  from 
the  Speech  Subsystem,  and  the  use  of  simulation  and  task  related  data.  The 
Simulation  Subsystem  also  processes  inputs  from  the  Instructor  Subsystem 
and  the  Data  Management  Subsystem  while  applying  inputs  to  the  Display  Sub¬ 
system  and  to  the  Instructor  Subsystem. 

The  Display  Subsystem  is  a  totally  self-contained  system  that  receives 
display  requests  and  produces  graphic  images  and  text  for  presentation  to 
the  trainee.  The  Display  Subsystem  receives  inputs  from  the  Instructor  and 
Simulation  Subsystems.  Based  on  inputs  from  the  Simulation  Subsystem,  the 
Display  Subsystem  provides  the  trainee  with  visual  representation  of  the 
approaching  aircraft,  carrier  deck  outline,  horizon,  sea/sky  conditions  and 
LSD  workstation  displays.  This  subsystem  is  also  responsible  for  providing 
sound  simulation  as  appropriate  to  scenario  requirements.  Examples  include 
flight  deck  sounds  and  the  engine  of  the  approaching  aircraft.  This  sub¬ 
system  is  completely  passive  and  generates  no  outputs  to  any  of  the  other 
subsystems . 

The  Voice  Subsystem  will  use  trainee  oriented  speech  data  and  student 
utterances  as  inputs  and  produce  data  indicative  of  the  recognized  spoken 
phrase.  It  will  also  generate  synthesized  speech  as  appropriate  to 
scenario  requ 1 rements.  Examples  include  the  pilot,  Air  Boss  and  CATCC 
personnel.  This  subsystem  will  interact  with  both  the  Instructor  and 
Simulation  subsystems. 
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The  Data  Management  Subsystem  Is  included  in  the  subsystem  diagram  even 
though  it  is  primarily  an  off-line  program.  This  subsystem  is  totally 
responsible  for  maintaining  the  integrity  of  all  data  used  by  the  LSO 
Training  System.  It  interacts  with  all  of  the  remaining  subsystems  except 
the  Display  Subsystem  in  the  off-line  mode.  To  ease  design  and  development 
time,  portions  of  the  Data  Management  Subsystem  will  be  used  during  run¬ 
time  by  other  subsystems  to  access  system  related  data. 

2.1.1  SIMULATION  SUBSYSTEM  MODULE  DESCRIPTIONS 

The  functional  areas  of  the  Simulation  Subsystem  are  shown  in  Figure 
F-4  and  discussed  below.  The  term  "scenario"  is  used  frequently  In  the 
discussion  below.  This  term  refers  to  the  training  situation  being  pre¬ 
sented  to  the  trainee.  The  scenario  consists  of  the  presentation  of  one  or 
more  carrier  landing  approaches  and  related  recovery  conditions  for 
instructional  explanation,  demrnstration  or  as  an  Interactive  training 
exercise.  The  elements  of  a  scenario  are  the  approaching  aircraft,  the 
carrier  and  LSO  workstation  conditions,  environmental  effects  (such  as 
wind,  deck  motion,  weather  and  horizon),  sounds  and  voices.  A  scenario  may 
be  only  a  single  approach  or  It  may  encompass  a  series  of  approaches.  The 
conditions  existing  in  a  series  of  approaches  may  be  relatively  stable 
(i.e.,  same  type  aircraft,  same  deck  and  environmental  conditions,  etc.)  or 
they  may  change  from  approach  to  approach  representative  of  a  carrier 
operations  recovery  cycle  (I.e.,  different  aircraft  types,  increasing  deck 
motion,  deteriorating  weather,  etc.). 

SIMULATION  EXECUTIVE.  The  Simulation  Executive  module  Is  the  heart  of  the 
Simulation  Subsystem.  It  controls  the  execution  of  the  Scenario  Generator 
and  Scenario  Monitor  subfunctions. 

Function.  The  Simulation  Executive  Is  responsible  for  routing  all  Incoming 
and  outgoing  message  traffic  —  the  individual  modules  and  subfunctions  are 
responsible  for  assuring  that  messages  are  properly  formatted.  The  Simula¬ 
tion  Executive  module  also  processes  errors  detected  within  the  Simulation 
Subsystem  and  manages  exception  handling.  Disk  file  accesses  are  also 
managed  by  the  Simulation  Executive  as  are  requests  for  user  (Instructor  or 
Trainee)  iput  from  the  Instructor  Subsystem.  The  Simulation  Executive  is 
also  responsible  for  data  management  requests  of  any  nature  (via  system 
disk  files)  by  use  of  selected  routines  from  the  Data  Management  Subsystem. 

Inputs.  Inputs  to  the  Simulation  Executive  consist  of  the  following: 

a.  Requests  for  Simulation  data  from  the  Training  System  Executive. 

b.  Requests  for  scenario  generations  based  on  Information  in  the 
Instructor  Subsystem.  These  data  consist  primarily  of  syllabus 
information. 


SIMULATION 

EXECUTIVE 


Figure  F-4.  SIMULATION  SUB  SYSTEM  MODULE  HIERARCHY 
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c.  Requests  for  Instructor  overrides  of  data  and/or  events  in  the 
scenario  file. 

d.  Formatted  messages  for  overall  system  control  and  synchroniza¬ 
tion. 

e.  Requests  for  data  and/or  services  from  subordinate  modules  in  the 
Simulation  Subsystem.  These  requests  fall  into  two  categories. 
The  first  is  for  services  within  the  Simulation  Subsystem  that 
the  Simulation  Executive  can  either  provide  directly  or  can 
obtain  from  another  subordinate  module.  The  second  type  of 
request  Is  for  services  and/or  data  that  reside  outside  the 
Simulation  Subsystem.  These  requests  are  passed  directly  on  to 
the  Training  System  Executive  for  final  processing. 

Outputs.  The  following  represent  outputs  from  the  Simulation  Executive: 

a.  Data  requested  by  the  Training  System  Executive.  These  data 
consist  mainly  of  aircraft  status  and  state  vectors,  feedback 
from  the  Pilot/Aircraft  models,  and  information  to  the  Display 
Subsystem.  These  data  are  also  used  by  the  Performance 
Monitoring  function  of  the  Instructor  Subsystem. 

b.  Data  and/or  services  to  modules  within  the  Simulation  Subsystem. 
These  correspond  to  "e."  above. 


SCENARIO  GENERATOR.  The  Scenario  Generator  module  functions  under  the 
Simulation  Executive  to  oversee  the  generation  of  scenarios. 

Function.  The  Scenario  Generator  module  provides  the  complete  high-level 
Interface  between  the  Instructor  element  and  the  actual  production  of 
scenarios  via  the  Basic  Scenario  Generator  and  Scenario  Detailer  modules. 
The  Scenario  Generator  module  Is  a  control  and  sequence  module  that  does 
not  directly  generate  any  data. 

Inputs.  Inputs  to  the  Scenario  Generator  consist  of  requests  from  the 
Instructor  Subsystem  Executive  via  the  Training  System  Executive  to 
generate  or  execute  a  scenario  specific  to  a  task,  key  concept,  or  critical 
situation  as  described  In  the  Syllabus  data  base  resident  in  the  Instructor 
Subsystem. 

Outputs.  Outputs  from  the  Scenario  Generator  consists  of  control  and 
sequence  data. 


BASIC  SCENARIO  GENERATOR.  The  Basic  Scenario  Generator  module  functions 
under  the  Scenario  Generator  to  build  the  basic  scenario  instructions  and 
then  process  them. 
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Function.  Building  scenario  Instructions  consists  of  processing  any 
existing  scenario  build  command  files  on  disk  and/or  Instructor  Inputs  from 
the  console.  These  scenario  Instructions  are  then  processed  so  that 
various  model  elements  are  selected  from  the  model  element  disk  files  and 
element  modifiers  are  Included.  This  results  an  Intermediate  scenario 
file  that  Is  passed  to  the  next  module  In  the  build  sequence. 

Inputs.  Inputs  to  the  Basic  Scenario  Generator  consist  of  specific 
scenario  data  requests  from  the  Instructor  Subsystem  Syllabus  data  base. 
These  function  as  Instructions  on  how  the  Basic  Scenario  Generator  Is  to 
combine  the  simple  elements  from  the  Simulation  Data  Base  -  the  various 
model  elements  and  scenario  templates  to  produce  a  scenario.  For  example, 
the  Instructions  may  request  (or  imply)  the  number  of  approaches,  type(s) 
of  aircraft,  types  of  profiles,  pilot  response  characteristics,  ship  and 
environmental  conditions,  etc.,  to  be  Included  in  the  scenario. 

Outputs.  Output  from  the  Basic  Scenario  Generator  Is  an  Intermediate 
scenario  file. 


SCENARIO  DETAILER.  The  Scenario  Detaller  module  functions  to  complete  the 
scenario  generation  process  by  using  the  Intermediate  file  as  Input  to 
produce  an  executable  scenario  file  for  use  by  the  LSO  Training  System 
Simulation  Subsystem  Executive. 

Function.  The  Scenario  Detaller  uses  the  Intermediate  scenario  file  as 
Tnput  for  processing  by  Its  three  subfunctions.  First,  the  Intermediate 
file  Is  scanned  for  conflicts  and  inconsistencies  resulting  from  model 
element  Interactions.  These  Interactions  can  result  from  build  Instruction 
errors  (of  logic.  Incorrect  actions  of  modifiers  and  situational  variables, 
and  Intrinsic  element  Interactions).  An  example  would  be  a  request  for  an 
external  aircraft  light  malfunction  In  a  day  carrier  landing  situation. 
These  Interactions  are  either  resolved  or  a  diagnostic  message  Is  Issued 
giving  the  cause  of  the  problem  and  whether  or  not  It  Is  possible  to 
continue  the  build. 

Second,  the  user  Is  given  the  opportunity  to  review  the  generated 
scenario  prior  to  saving  It.  At  this  time  the  user  may  alter  those 
portions  of  the  scenario  that  are  deemed  Inappropriate.  However,  it  Is 
highly  recommended  that  user  modifications  be  used  sparingly  and  Judi¬ 
ciously  as  the  training  value  of  the  scenario  may  be  adversely  affected. 

Last,  a  scenario  data  file  is  generated  for  use  by  the  Scenario 
Monitor.  While  the  above  paragraphs  describe  an  off-line  session,  the  same 
sequence  of  events  occurs  during  a  dynamic  generation  session  with  the 
exception  that  there  Is  no  provision  for  reviewing  the  finished  product.  . 

Inputs.  Inputs  to  the  Scenario  Detaller  consist  of  the  intermediate 
scenario  file.  Instructor/user  requests  or  overrides,  and  specific  Informa¬ 
tion  from  the  model  files  to  resolve  model  interactions. 
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Outputs.  The  primary  outputs  from  this  function  consist  of  a  revlewable 
scenario  file  and/or  a  saved  executable  scenario. 


SCENARIO  MONITOR.  The  Scenario  Monitor  module  executes  under  the  control 
of  the  Simulation  Executive  module  and  controls  all  aspects  of  scenario 
execution  and  simulation  control. 

Function.  The  Scenario  Monitor  module  controls  scenario  execution  via  the 
Scenario  Control,  Queue  Control,  Model  Control,  and  Monitor  Scenario  Status 
subfunctions.  The  Scenario  Monitor  handles  disk  file  accesses  of  scenario, 
task,  and  simulation  related  data.  It  also  controls  the  Simulation  Timer 
Event  Queue.  This  Is  a  queue  of  timers  that  are  associated  with  the 
occurrence  or  non-occurrence  of  selected  and  pre-deflned  events.  Like  the 
Scenario  Generator  module,  the  Scenario  Monitor  module  Is  primarily  a 
control  module  only  and  generates  no  data. 

Inputs.  Inputs  to  the  Scenario  Monitor  consist  of  requests  from  the 
Training  System  Executive  to  execute  a  scenario  as  well  as  Inputs  from  the 
subordinate  modules  from  within  the  Simulation  Subsystem.  These  Internal 
Inputs  Include  the  scenario  file,  data  from  the  scratch  pad  disk  file,  data 
from  the  Simulation  Subsystem  Data  base,  and  additional  information  from 
any  pre-existing  record/playback  files. 

Outputs.  The  outputs  from  this  function  consists  primarily  of  commands  to 
the  Model  Control  submodule,  the  Queue  Control  submodule,  and  the  Monitor 
Scenario  Status  submodule. 


SCENARIO  CONTROL.  The  Scenario  Control  module  Is  a  submodule  of  the 
Scenario  Monitor  module.  Its  function  is  to  control  the  basic  actions 
selected  In  the  scenario  data  file  subject  to  modifications  triggered  by 
Instructor  and/or  Trainee  Inputs,  and  event  Interactions. 

Function.  It  accomplishes  this  by  processng  a  series  of  events  and  their 
interactions.  Events  may  be  of  two  types,  synchronous  and  asynchronous, 
each  of  which  Is  maintained  In  a  separate  data  structure.  Synchronous 
events  are  t^ose  events  which  are  predictable  In  advance  and  dependent  on 
some  variable  such  as  time,  distance,  altitude,  etc.  An  example  would  be 
the  requirement  for  a  low,  slow  approach  profile  deviation  at  a  range 
representative  of  "In  the  middle"  (4000  feet  from  touchdown).  Another 
would  be  the  requirement  to  Initiate  an  aircraft  engine  failure  at  a  pre¬ 
defined  range.  Asynchronous  event:  are  those  that  occur  primarily  because 
of  some  external  action  such  as  Instructor  or  Trainee  Input.  The  most 
frequent  examples  of  this  type  event  will  be  the  actions  of  the  LSO  trainee 
(voice  calls,  light  signals).  Element  Interactions  may  be  either 
synchronous  or  asynchronous  depending  on  what  single  or  multiple  event 
caused  them. 


NAVTRAEQUIPCEN  80-C-0063-2 


Inputs.  Inputs  consist  of  the  Synchronous  and  Asychronous  Event  Queues, 
event  Interaction  modifiers  from  the  model  element  files  of  the  Simulation 
Subsystem  Data  base,  and  Instructor  and  Trainee  Inputs  (e.g.  voice  calls). 

Outputs.  Outputs  are  mainly  concerned  with  display  commands  to  the  Display 
Subsystem  and  commands  to  the  Model  Control  module. 


QUEUE  CONTROL.  The  Queue  Control  module  builds  and  maintains  the  synchro¬ 
nous  and  asynchronous  event  queues. 

Function.  These  queues  are  simply  two  lists  of  actions  to  be  taken  based 
on  exercise  time,  distance,  or  some  other  task  or  scenario  related  vari¬ 
able.  These  actions  may  be  based  on  a  single  variable  or  combinations  of 
variables.  At  periodic  Intervals  or  when  an  asynchronous  event  has 
occurred,  the  Queue  Control  module  reevaluates  the  Information  contained 
In  the  two  queues  and  may  restructure  them  If  needed.  Event  Interactions 
may  also  cause  queue  reevaluation. 

Inputs.  Inputs  to  the  Queue  Control  module  consist  of  time  and  or 
positional  event  data  from  the  scenario  file  and  Instructor/Trainee  Inputs. 

Outputs.  The  output  of  the  Queue  Control  module  consists  of  updated 
Synchronous  and  Asynchronous  Event  Queues. 


MODEL  CONTROL.  The  Model  Control  module  controls  the  execution  of  the 
various  model  elements  used  during  the  scenario. 

Function.  Model  Control  functions  to  control  the  simulation  of  the  actions 
and  conditions  of  the  aircraft,  the  pilot,  the  environment,  etc.  The 
elements  to  be  used  are  maintained  on  an  execution  list  based  on  scenario 
data.  At  periodic  Intervals  during  scenario  execution,  the  Model 
Controller  Invokes  the  various  model  elements.  When  Invoked,  the  elements 
operate  on  the  simulation  data  structures  resulting  In  updated  positions, 
pilot,  aircraft,  or  environmental  actions.  For  example,  Model  Control  will 
"fly*  the  aircraft  In  accordance  with  the  profile  specified  In  scenario 
Instructions.  It  will  also  activate  the  appropriate  pilot  response  for  a 
LSO  trainee  voice  call  Input.  These  updated  simulation  data  are  used  by 
the  Monitor  Scenario  Status  module. 

Inputs.  Inputs  to  the  Model  Control  module  consist  of  scenario  Instruc- 
Tfons  and  related  data,  the  Synchronous  and  Asynchronous  Event  Queues,  and 
feedback  on  trainee  actions  from  the  Instructor  Subsystem. 

■  • 

Outputs.  Outputs  from  the  Model  Control  module  consist  of  commands 
Thvoklng  the  various  model  elements  used  In  the  Simulation  Subsystem. 
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MONITOR  SCENARIO  STATUS.  The  Monitor  Scenario  Status  module  executes  under 
the  control  of  the  Scenario  Monitor  module.  It  Is  responsible  for  main¬ 
taining  and  providing  updates  of  aircraft  status  and  other  situation 
variables. 

Function.  Monitor  Scenario  Status  provides  Information  on  aircraft  status 
(position,  velocity,  attitude,  etc.)  and  other  situation  variables  (wind, 
deck  motion,  etc.)  to  the  Instructor  Subsystem,  and  display  updates  (In 
terms  rf  display  related  coordinates)  to  the  Display  Subsystem.  Display 
and  status  updates  are  provided  on  a  periodic  basis.  Updates  of  aircraft 
position  must  be  at  the  rate  of  at  least  fifteen  per  second.  Status 
updates  may  be  requested  at  any  time  to  facilitate  asynchronous  event 
processing  either  by  other  modules  In  the  Simulation  Subsystem  or  by  the 
Training  System  Executive  for  use  by  other  parts  of  the  system. 

Inputs.  Inputs  to  the  Monitor  Scenario  Status  module  consist  of  elapsed 
time  "Bata,  event  related  data,  and  scenario  execution  data. 

Outputs.  The  primary  outputs  of  this  module  are  aircraft  status  Informa¬ 
tion.  It  also  outputs  Information  on  other  situation  variables. 

2.1.2  SYSTEM  SOFTWARE 

The  LSO  Training  System  software  Is  divided  Into  system  software  and 
applications  software.  The  system  software  selected  for  the  LSO  Trainer 
will  be  Influenced  by  the  final  hardware  selection  but  It  Is  assumed  that 
It  will  be  supplied  either  by  the  hardware  manufacturer  or  a  reputable 
-software  house. 

The  design  of  the  ISO  Training  System  assumes  that  the  system  software 
will  p  uvlde  the  capabilities  discussed  below. 

EXECUTIVE.  The  Executive  shall  be  capable  of  handling  all  low  level  device 
Interactions  as  well  as  Interpretation  of  console  (CRT)  user  Inputs.  The 
Executive  shall  be  capable  of  controlling  multi-task  programs. 

LANGUAGE  PROCESSORS.  The  system  software  shall  provide  at  least  one  High 
Level  Language  (HLL)  to  be  used  for  software  development.  While  the  exact 
language  to  be  used  will  be  greatly  Influenced  by  the  final  hardware  selec¬ 
tion,  some  of  the  advantages  and  disadvantages  of  several  of  today's  cur¬ 
rently  popular  HLLs  are  discussed  below. 

This  discussion  will  center  on  only  a  handful  of  the  dozens  of  HLLs 
available  and  In  use  today.  These  HLLs  fall  Into  two  broad  groups  - 
unstructured  and  structured.  However,  all  do  share  some  common  character¬ 
istics  which  make  them  desirable  for  use  In  the  LSOTS  software  development 
effort.  They  all  maLe  use  of  symbolic  variable  naming  constructs.  They 
vary  In  the  allowable  length  of  variable  names  and  legal  characters.  Most 
all  of  them  have  at  least  one  implementation  that  supports  separate  compi¬ 
lation  of  program  units  (eg.  procedures,  subroutines,  functions,  etc.). 
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All  HLLs  have  floating  point.  Integer,  and  logical  data  types.  They  all 
feature  powerful  numerical  processing  capabilities.  Host  support  some 
system  of  statements  to  Implement  various  control  and  sequencing  capabili¬ 
ties  and  to  perform  logical  tests  of  equality.  Finally,  most  are  available 
for  a  variety  of  hardware  suites.  The  HLL  selected  for  the  LSOTS  develop¬ 
ment  must  be  standardl2ed,  supported  on  a  wide  selection  of  hardware, 
readily  available,  and  widely  known  and  used. 

The  discussion  of  structured  languages  available  today  begins  with 
PL/I  and  Its  subset  compilers.  PL/I  Is  an  extremely  powerful  and  versatile 
language  developed  several  years  ago  by  IBM.  PL /I  supports  all  the  advan¬ 
tages  listed  above  and  some  peculiar  capabilities  associated  with  defining 
the  precision  of  numbers  and  Implementation  of  bit  fields.  The  latter 
capability  Is  especially  useful  when  memory  Is  a  limiting  resource  and 
execution  time  Is  not.  PL/I  also  has  a  character  data  type  which  can  be 
especially  useful.  The  main  disadvantage  to  using  a  member  of  the  PL/I 
family  Is  that  Its  compilers  tend  to  be  somewhat  memory  Inefficient  In  the 
code  generated  and  that  almost  all  Implementations  are  for  either  large  IBM 
mainframes  or  small  microprocessor  based  systems.  For  these  reasons  PL/I 
Is  not  considered  to  be  a  serious  contender. 

PASCAL  and  Its  variants  are  extremely  attractive  as  HLLs  for  software 
Implementation  because  of  the  expanded  nature  of  their  statements  for 
controlling  program  execution.  This  allows  algorithms  to  be  implemented  in 
a  very  human  oriented  manner.  Another  Important  feature  that  PASCAL 
possesses  Is  Its  rich  variety  of  data  types  as  well  as  the  RECORD  feature. 
This  allows  the  designer/programmer  to  easily  and  quickly  define  new  data 
types  and  data  structures  as  the  need  arises  and  to  specify  clearly  read¬ 
able  (and  efficient)  algorithms  for  their  access. 

PASCAL  Is  not  without  Its  disadvantages.  First  and  foremost,  most 
Implementations  of  PASCAL  are  interpreted.  This  Is  due  mainly  to  the 
origins  of  PASCAL  and  why  It  even  came  about.  Since  LSOTS  Is  a  real  time 
system,  a  high  overhead  Interpreted  software  system  simply  cannot  be 
tolerated.  PASCAL  also  suffers  from  a  lack  of  standardization.  While  many 
Implementations  share  the  spirit  of  the  original  language  specification, 
vendors  tend  to  add  extensions  that  make  the  language  somewhat  less  than 
portable.  While  this  happens  with  nearly  all  languages  developed  by  ven¬ 
dors,  Its  effects  are  especially  detrimental  when  there  Is  no  standard 
language  specification  upon  which  a  majority  of  Implementors  can  base  their 
designs.  Also  related  to  this  Is  the  fact  that  PASCAL  Is  still  not  a 
widely  accepted  language  outside  of  the  university  community  and  while  many 
hardware  manufacturers  offer  or  claim  to  offer  a  PASCAL,  many  still  do  not. 
These  reasons  all  tend  to  reduce  the  desirability  of  using  PASCAL  for  LSOTS 
software  development. 


ALGOL  Is  a  language  that  Is  a  predecessor  of  PASCAL.  Both  languages 
share  many  common  characteristics  which  may  at  first  seem  to  make  ALGOL  the 
obvious  choice,  but  ALGOL  also  suffers  from  many  of  the  same  shortcomings 
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as  does  PASCAL  with  two  Important  additions.  One,  the  language  specifica¬ 
tion  for  ALGOL  does  not  Include  any  provision  for  Input/output.  While  the 
reasons  for  this  may  at  one  time  have  been  clear,  the  result  is  ludicrous. 
The  main  function  of  over  half  of  all  programs  written  and  over  90  percent 
of  each  program's  execution  time  is  spent  either  doing  or  waiting  for 
Input/output.  Lack  of  an  Input/output  specification  is  more  than  likely 
the  primary  reason  that  there  are  so  very  few  ALGOL  compilers  available 
today  and  that  those  that  are  used  are  so  very  different.  Thus,  ALGOL  can 
be  eliminated. 

Mention  Is  made  now  of  ADA  since  It  fits  in  the  category  of  structured 
languages  and  Is  viewed  by  many  to  be  the  ultimate  solution  to  the  software 
development  problem.  ADA  incorporates  most  of  the  "good"  features  of  the 
more  popular  HLLs  available  on  the  market  today.  It  Is  also  DoD's  choice 
for  software  In  embedded  applications.  ADA  Is  not  a  serious  choice  because 
there  are  currently  no  commercially  available  compilers  on  the  market. 
Furthermore,  ADA  is  what  could  be  termed  too  powerful  for  the  LSOTS  appli¬ 
cation  since  there  are  few  of  what  are  called  exceptions  In  the  LSOTS 
software  architecture.  Perhaps  In  the  future  ADA  will  become  the  primary 
HLL  for  use  In  military  applications. 

The  next  candidate,  HLL,  Is  not  actually  a  structured  language,  yet  it 
has  so  many  advantages  that  It  Is  Included  In  the  discussion.  That  HLL  Is 
called  MC".  It  was  developed  with  a  specific  hardware  architecture  In  mind. 
It  therefore  takes  advantage  of  that  architecture  In  Its  capabilities  and 
structures.  "C"  further  has  the  advantage  of  having  all  the  power  and 
flexibility  of  assembly  language  without  the  headaches.  While  many  people 
still  have  not  heard  of  "C",  those  who  have  tend  to  become  part  of  a  group 
of  dedicated  users.  However,  "C"  suffers  from  the  same  two  faults  as  do 
the  previously  mentioned  languages  -  lack  of  standardization  and  limited 
Implementation  on  a  wide  selection  of  hardware. 

The  final  HLL  In  the  discussion  Is  also  the  only  non-structured 
language  considered.  That  HLL  Is  FORTRAN.  FORTRAN  is  probably  the  oldest 
and  most  widely  accepted  HLL  currently  In  existence.  It  Is  also  the 
closest  thing  to  a  truly  standard  and  portable  HLL  available  -  mostly  due 
to  Its  long  existence.  Virtually  every  hardware  maufacturer  supports  at 
least  one  standard  version  of  FORTRAN.  All  usually  have  various  exten¬ 
sions,  but  over  the  years  even  the  extensions  have  tended  to  become 
standardized.  FORTRAN  has  the  advantages  of  wide  availability,  support, 
and  use.  It  Is  standardized  and  eminently  portable. 

FORTRAN  does  have  two  serious  drawbacks.  One  Is  that  Its  control 
statements  have  been  criticized  as  awkward  and  lending  themselves  to 
unstructured  programs  full  of  "GOTOs."  The  other  is  that  FORTRAN  has 
almost  no  data  structure  capabilities  other  than  arrays  and  matrices.  The 
former  drawback  Is  annoying  while  the  latter  Is  frustrating  and  serious. 
Both  of  these  have  helped  give  FORTRAN  a  bad  reputation  for  applications 
requiring  manipulation  of  l^rge  data  structures  of  varying  data  types. 
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These  problems  have  been  somewhat  solved  by  the  latest  ANSI  specifica¬ 
tion  for  FORTRAN  77.  This  specification  extends  the  allowable  control 
statements  and  adds  new  data  types.  If  one  of  the  various  commercially 
available  FORTRAN  structured  preprocessors  Is  combined  with  a  FORTRAN  77 
Implementation,  the  result  should  satisfy  all  the  HLL  requirements  listed 
earlier  as  well  as  provide  a  software  development  environment  that  Is  both 
productive  and  as  close  to  portable  and  hardware  Independent  as  Is  practi¬ 
cable. 

Based  on  the  above  discussion,  the  HLL  used  for  LSOTS  software 
development  should  be  a  FORTRAN  compiler  (ANSI  77  or  later  if  possible) 
used  in  conjunction  with  a  commercially  available  structured  FORTRAN  pre¬ 
processor. 

UTILITY  PROCESSORS.  The  system  software  shall  also  provide  an  assortment 
of  utility  programs  including  editors,  assemblers  (macro  type  preferred), 
standard  device  drivers,  debugger(s),  linking  loader,  object  file 
librarian,  and  file  manager.  Also  included  shall  be  object  libraries  for 
peripheral  use  and  system  specific  operations. 

FILE  SYSTEM.  The  operating  system  shall  provide  a  means  of  storing  Infor¬ 
mation  In  the  form  of  disk  files.  This  file  system  shall  be  designed  to 
support  sequential,  random,  and  Indexed  sequential  file  structures  using 
either  contiguous  or  linked  disk  allocation  schemes.  Files  should  be 
accessible  for  creation,  deletion,  updating,  or  extending  from  either  a 
user  console  or  under  program  control. 

SIMULATION  EXECUTIVE.  All  simulation  and  modelling  related  activities  will 
be  monitored  and  coordinated  by  the  Simulation  Executive.  This  program  Is 
one  of  a  series  of  executives  that  resides  and  functions  In  each  subsystem 
of  the  LSOTS.  The  primary  functions  of  the  Simulation  Executive  are: 

o  provide  run-time  support  for  the  remaining  modules  and  submodules 
In  the  Simulation  subsystem 

o  provide  for  handling  message  traffic  between  the  other  subsystems 
and  between  modules  within  the  subsystem 

o  provide  dynamic  scheduling  of  the  modules  in  the  Simulation 
subsystem  as  run-time  needs  and  message  traffic  require 

o  provide  an  Interface  to  the  DATA  MANAGEMENT  subsystem 

o  provide  an  Internal  mechanism  to  monitor  the  status  of  program 

execution  and  supply  the  other  subsystems  with  this  information 

The  remaining  sections  of  this  document  generically  describe  the 
submodules  in  the  Simulation  Executive  and  the  functions  they  perform. 
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INITIALIZATION.  The  Initialization  module  Is  invoked  whenever  the  system 
Is  Initially  started  or  when  the  system  performs  a  Master  Reset  after  an 
error  condition  has  been  detected  or  when  requested  by  the  Instructor.  The 
Initialization  module  Is  composed  of  the  five  submodules  described  below. 

SbSPrep.  The  function  of  the  SbSPrep  submodule  Is  to  allocate  and  Initia¬ 
te  the  root  buffers  of  the  Simulation  Executive.  Root  buffers  are  those 
buffers  which  the  EXEC  needs  for  temporary  work  space  before  any  other 
buffer  functions  can  be  performed.  These  buffers  are  not  part  of  those 
maintained  by  the  BUFFER  MANAGEMENT  module  and  are  transparent  to  the  rest 
of  the  Simulation  Executive.  SbSPrep  also  Initializes  and  maintains  the 
variables  associated  with  root  buffer  management  { 1  .e.  pointers,  use 
counts,  locks,  etc.). 

SfSPrep.  The  function  of  the  SfSPrep  submodule  Is  to  open  and  read  In  the 
System  Parameter  file  Into  one  of  the  root  buffers  for  use  by  the  remaining 
submodules  of  the  Initialization  modle.  SfSPrep  Is  also  responsible  for 
creating  any  temporary  work  files  needed. 


SvSIn It.  The  SvSInlt  submodule  performs  all  functions  associated  with 
Initial izatlon  of  system  variables.  These  Initial  values  are  contained  In 
a  System  Parameter  file  which  SvSInlt  reads  In  and  uses. 

SdSInit.  The  SdSInft  submodule  is  responsible  for  initializing  all  system 
data  areas  and  tables.  The  Initial  values  for  some  of  these  tables  are 
contained  In  the  System  Parameter  file  which  was  opened  by  SvSImt.  The 
remainder  of  the  system  tables  are  initialized  to  default  values. 

TcSInlt.  The  TcSInlt  submodule  forms  all  the  functions  that  allow  the 
remaining  submodules  that  are  tasks  In  the  Simulation  Executive  to  perform 
their  local  initialization.  TcSInlt  does  this  by  first  creating  these 
tasks  and  then  "waking  them  up"  so  that  they  may  perform  their  Initializa¬ 
tion.  Once  complete,  each  task  will  then  suspend  Itself  until  required  by 
the  EXEC.  The  TcSInlt  submodule  accomplishes  this  by  creating  those  tasks 
named  In  the  System  Task  Table  that  was  Initialized  by  SdSInit.  TcSInlt 
will  kill  the  Initialization  task  once  Initialization  Is  completed. 

TIMER  MANAGEMENT.  The  Timer  Management  module  Is  responsible  for  managing 
all  timer  and  timing  related  operations  for  all  timers  used  In  the  Simula¬ 
tion  subsystem.  There  are  currently  3  timers  defined.  They  are  a  local 
timer  that  keeps  elapsed  wall  clock  time,  a  master  timer  that  tracks 
scenario  elapsed  time,  and  a  freeze/event  timer  that  is  used  to  track  time 
spent  In  freezes  and  to  determine  when  an  event  should  be  triggered. 

TSInlt.  This  submodule  Initializes  all  timer  variables  and  data  areas 
Including  the  DELAYED  EVENT  QUEUE.  It  also  establishes  linkage  with  the 
hardware  clock  and  sets  the  Initial  clock  rate  and  therefore  the  value  of  a 
“tick". 
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TSStart.  The  TJStart  submodule  Is  called  by  a  user  module  to  start  timer 
#n  from  Its  current  value.  No  check  is  made  of  what  the  current  value  Is. 

TIStop.  This  submodule  stops  timer  #n  and  preserves  Its  current  value. 

TSReset.  TSReset  clears  timer  In  to  zero  and  starts  It. 

TSSet.  The  TISet  submodule  Is  called  to  set  timer  In  to  a  specified  value 
without  starting  the  timer. 

TSClear.  This  submodule  Is  called  to  clear  timer  In  to  zero  without  star¬ 
ting  the  timer. 

T*Add.  T$Add  adds  an  event  #m  to  the  delay  queue  associated  with  timer  In. 

TSRemove.  The  TSRemove  submodule  Is  called  to  remove  event  Im  from  the 
delay  queue  associated  with  timer  In. 


MODULE  SCHEDULER.  The  Module  Scheduler  module  Is  responsible  for 
scheduling  the  execution  of  all  run-time  (or  user)  modules  In  the  Simula¬ 
tion  subsystem.  This  module  Implements  the  submodules  described  below. 

SSI  nit.  The  SSInit  submodule  Is  responsible  for  Initializing  all  local 
variables,  data  areas,  and  tables.  This  also  includes  the  ACTIVE  MODULE 
TABLE.  This  table  Is  a  list  of  all  modules  that  are  currently  active  and 
need  to  be  executed.  At  Initialization,  all  modules  are  active  so  they  may 

Rerform  any  Initialization  local  to  them.  Once  completed,  the  ACTIVE 
ODULE  TABLE  entries  are  adjusted  so  that  or.ly  those  modules  required  for 
the  current  training  state  are  used. 

SSCreate.  This  submodule  Is  responsible  for  creating  tasks  for  those 
modules  in  the  ACTIVE  MODULE  TABLE  that  are  defined  as  tasks.  A  task  that 
has  been  created  does  not  necessarily  execute  immediately-  SSCreate  only 
ensures  that  the  required  tasks  are  created. 

SSQueue.  The  function  of  this  module  Is  to  build  and  maintain  the  ACTIVE 
MODULE  QUEUE.  This  Is  a  list  of  those  modules  and  tasks  that  are  candi¬ 
dates  for  delayed  execution  at  some  future  point  In  time.  The  requisites 
for  delayed  execution  may  be  time,  positional,  or  occurrence  or  non-occur- 
rence  of  a  specific  event. 

SSWakeup.  The  SSWakeup  submodule's  purpose  Is  t j  activate  or  wake  up  those 
tasks  (or  modules)  that  are  ready  to  be  executed  as  listed  In  the  ACTIVE 
MODULE  TABLE  and  ACTIVE  MODULE  QUEUE.  SSWakeup  also  activates  a  task/ 
module  on  the  receipt  of  an  Incoming  message  e.ther  from  outside  the 
Simulation  subsystem  or  from  another  module  or  submodule  within  it. 
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SSSuspend.  This  submodule's  purpose  Is  to  suspend  the  execution  of  en 
active  taste  or  module  and  place  It  as  an  entry  In  the  SUSPEND  TABLE.  Tasks 
or  modules  that  have  been  suspended  may  only  be  awakened  when  the  cause  of 
their  suspension  has  been  removed.  Suspension  may  be  based  on  time,  posi¬ 
tion,  the  occurrence  or  non-occurrence  of  an  event,  or  by  specific  request. 

SSK111.  The  S$K111  submodule  Is  called  to  kill  the  execution  of  a  cur¬ 
rently  running  module  or  task.  A  suspended  or  non-existent  task  or  sus¬ 
pended  module  cannot  be  killed. 

SSDequcue.  This  submodule's  responsibility  Is  to  remove  a  task  or  module 
from  the  ACTIVE  MODULE  QUEUE  either  by  request  or  the  occurrence  of  a 
specific  event.  Once  removed,  a  task  or  module  must  be  either  active, 
suspended,  or  killed. 

ERROR  PROCESSOR.  The  Error  Processor  module  Is  responsible  for  monitoring 
the  Internal  status  of  the  Simulation  subsystem  and  report  any  errors, 
warnings,  or  Informative  messages  to  the  rest  of  the  system.  The  Error 
Processor  accomplishes  this  by  monitoring  a  specific  area  In  memory  known 
■s  the  SYSTEM  STATUS  TABLE.  Most  modules  and  submodules  In  the  subsystem 
will  define  variables  In  this  table  to  report  status  and  error  conditions. 
The  Error  Processor  as  an  asynchronous  task,  will  constantly  examine  this 
table.  Interpret  Its  contents,  and  report  the  results.  Additionally,  any 
module  or  submodule  In  the  system  may  send  a  message  to  the  Error  Processor 
reporting  Its  status.  Upon  detecting  an  exception  condition,  the  Error 
Processor  will  take  one  or  more  of  the  following  actions: 

o  send  a  message  to  the  affected  subsystem,  cause  the  condition  to 
be  displayed  on  the  Instructor  console,  and  allow  program 
execution  to  continue.  This  Is  used  to  display  Informative 
messages  only. 

o  suspend  system  execution,  cause  the  condition  to  be  dlslayed  on 
the  Instructor  console,  and  ask  If  execution  should  be  allowed 
to  continue.  This  Is  most  commonly  used  for  warning  conditions 
that  may  affect  the  program's  operation  in  mild  but  unpredictable 
ways. 

o  send  a  message  to  all  o^her  subsystems,  cause  the  message  to  be 
dlslayed  on  the  Instructor's  console,  and  terminate  the  execution 
of  the  Simulation  subsystem.  This  will  occur  only  when  severe 
error  conditions  are  detected  that  would  adversely  affect  program 
execution  and  reduce  training  effectiveness  of  the  system  as  a 
whole. 

The  submodules  that  comprise  the  Error  Processor  are  described  below. 

ESInlt.  The  ESInlt  submodule  Is  responsible  for  all  local  variable  and 
data  area  and  table  initialization.  The  MONITOR  CONTROL  TABLE  Is  one  of 
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these.  This  Is  a  table  of  all  status  variables  In  the  SYSTEM  STATUS  TABLE, 
the  name  of  the  task  nodule,  or  submodule  responsible  for  updating  It,  and 
the  action  to  be  taken  by  the  Error  Processor  when  one  of  the  three  error 
conditions  Is  detected. 

ESHonltor.  This  submodule's  purpose  Is  to  periodically  examine  the  SYSTEM 
STATUS  TABLE  to  see  If  any  variables  have  been  changed  to  an  error  condi¬ 
tion.  When  an  error  Is  detected,  ESMonltor  consults  the  appropriate  entry 
In  the  MONITOR  CONTROL  TABLE,  takes  the  actions  previously  described,  and 
transfers  control  to  one  of  the  three  submodules  described  below. 

ESMessage.  The  ESMessage  submodule  Is  responsible  for  causing  an  Informa- 
tlve  message  to  be  routed  through  the  system.  Normally  this  Is  only  to  the 
Instructor  console  to  provide  him  with  additional  Information  regarding  the 
status  of  the  system. 

ESWarn.  This  submodule  Is  responsible  for  causing  a  warning  message  to  be 
routed  through  the  system  to  any  tasks,  modules,  or  submodules  that  may 
require  It  to  ensure  their  continued  execution.  The  warning  message  is 
also  displayed  on  the  Instructor  console.  If  the  condition  Is  serious 
enough,  the  Instructor  may  be  given  the  option  to  stop  execution  of  the 
system  based  on  his  observations  of  Its  performance,  the  nature  of  the 
warning,  and  his  appraisal  of  the  training  value  of  continuing. 

ESFatal.  The  ESFatal  submodule's  purpose  Is  to  cause  a  fatal  message  to  be 
sent  to  the  remaining  subsystems,  send  a  message  to  the  Instructor  console, 
and  terminate  program  execution  In  the  Simulation  subsystem. 


2.2  DATA  STORAGE  AND  SERVICE  ROUTINES 

Within  the  LSO  Training  System,  the  use  of  common  data  storage  areas 
should  be  kept  to  a  minimum.  This  will  result  In  a  strongly  connected 
system  since  most  control  and  status  Information  must  be  communicated  among 
the  modules  that  need  It  by  parameter  passing. 

There  may  be  Instances  where  a  common  data  area  Is  the  most  efficient 
solution  to  the  problem  of  access  speed  and  sharing.  For  this  reason,  some 
common  data  will  be  allowed  but  the  following  represent  the  criteria  for 
placing  data  In  the  common  area: 

a.  The  amount  of  data  required  by  the  modules  Is  larger  than  will 
practically  fit  In  an  Inter-Module  Message  (IMM),  or  the  number  of  passed 
parameters  Is  large.  The  key  point  to  consider  here  is  the  trade-off 
between  modularity,  storage  utilization,  and  Intrinsic  overhead.  For  data 
requirements  of  up  to  about  100  words,  the  IMM  Is  the  preferred  method. 
When  message  lengths  Increase  much  beyond  this,  storage,  overhead,  and  time 
costs  may  make  the  IMM  Impractical. 
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b.  The  frequency  of  data  access  Is  high  enough  to  risk  overflowing  the 
receiving  nodule's  message  queue.  What  constitutes  high  frequency  should 
be  determined  as  the  design  progresses  to  the  detailed  stage. 

c.  The  timing  requirements  of  a  module  are  critical  enough  so  that  1MM 
usage  would  seriously  degrade  system  performance.  This  Is  also  somewhat  of 
a  subjective  decision,  but  certain  Items  are  excellent  Indicators  of  per¬ 
formance.  These  Include  graphics  displays,  keyboard  responses,  and  speech 
recognition  delays. 

The  high  level  modules  used  for  data  storage  and  service  are  discussed 
below. 

BUFFER  MANAGEMENT.  This  submodule  Is  responsible  for  managing  all  system 
and  user  requests  for  buffers.  This  Is  accomplished  by  calls  to  the  sub- 
modules  described  below. 

BSInlt.  This  submodule  Initializes  all  buffer  variables  and  builds  the 
buffer  available  and  In-use  queues.  It  also  sets  up  all  allocation, 
releasing,  and  management  variables. 

BSAlloc.  This  submodule  Is  used  by  the  BUFFER  MANAGEMENT  module  to 
allocate  additional  blocks  of  memory  to  the  buffer  pool  after  Initializa¬ 
tion  and  during  run-time  If  the  user  modules  request  more  buffers  than  are 
currently  available.  If  no  memory  can  be  allocated,  BSAlloc  returns  an 
error  code,  otherwise  It  allocates  the  memory  to  a  buffer,  links  the  buffer 
Into  the  available  queue,  and  updates  the  variables  associated  with  the 
available  queue. 

BSRelease.  BSRelease  Is  used  to  delete  unused  buffers  from  the  available 
queue  and  return  the  memory  they  used  to  the  host  operating  system  for 
other  uses.  Buffers  will  be  released  only  when  a  selectable  percentage  of 
them  are  unused  for  some  period  of  time  which  will  also  be  selectable. 
This  feature  will  allow  the  system  to  be  fine  tuned  to  maximize  memory  use 
while  minimizing  run-time  overhead. 

BSGet.  This  submodule  Is  called  by  user  modules  to  request  a  buffer  for 
use  from  the  free  pool.  If  a  buffer  Is  free.  It  Is  removed  from  the  free 
queue,  added  to  the  In-use  queue,  and  the  associated  queue  maintenance 
variables  are  updated.  BSGet  returns  a  pointer  to  the  buffer,  a  buffer 
Identifier,  and  Its  length.  If  not  buffers  are  free,  BSGet  will  call 
BSAlloc  In  an  attempt  to  allocate  more  memory  for  buffers.  If  the  call  to 
BSAlloc  falls,  then  BSGet  will  return  an  error  code  to  Its  caller. 

BSPut.  This  submodule  Is  called  to  return  a  buffer  to  the  free  queue.  The 
tilling  module  need  only  supply  the  buffer  Identifier  that  was  returned  by 
BSGet.  BSPut  does  not  return  any  error  codes. 

BSSet.  BSSet  Is  used  by  user  modules  to  Initialize  a  buffer  to  some  value 
supplied  by  the  user.  The  caller  must  supply  the  buffer  Identifier  and  the 
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desired  value.  BSSet  Initializes  the  entire  buffer  to  the  value  and  does 
not  check  to  see  If  the  -Initialization  value  "fits".  B$Set  does  not  return 
any  error  codes. 

MESSAGE  PROCESSOR.  The  Message  Processor  nodule  Is  responsible  for  all 
external  nessage  traffic  (between  other  subsystems)  and  all  Internal  mes¬ 
sage  traffic  between  nodules  In  the  Simulation  subsystem.  This  module  Is 
Implemented  as  a  separate  asynchronous  task  composed  of  the  following 
submodules. 

MSInlt.  The  MSlnlt  submodule  Is  responsible  for  Initializing  the  message 
areas,  allocating  buffer  space,  and  synchronizing  Intersystem  message 
links.  When  finished,  all  LSOTS  subsystems  should  be  In  communication  with 
each  other.  MSInlt  will  return  an  error  code  If  buffer  allocation  falls  or 
synchronization  does  not  occur  after  ten  retries.  If  either  of  these 
conditions  occurs,  a  fatal  system  error  will  occur. 

MSSend.  This  submodule  Is  called  by  a  user  module  to  place  a  message  In 
the  queue  to  be  sent  to  another  subsystem.  The  caller  Is  responsible  for 
all  message  data  validation  and  supplying  the  buffer  for  the  message. 
MSSend  will  return  an  error  code  only  If  the  send  queue  overflows.  There 
will  be  no  acknowledgement  of  the  message  being  sent  and  none  of  Its 
receipt  unless  provided  for  by  the  two  submodules  communicating. 

MSRecelve.  MSRecelve  Is  a  separate  task  within  the  Message  Processor 
called  by  user  submodules  to  receive  a  message  from  another  subsystem. 
MSRecelve  will  return  a  pointer  to  the  buffer  containing  the  message  If  one 
Is  waiting  or  a  code  signifying  that  no  messages  have  been  received  for  the 
caller.  MSRecelve  Is  subject  to  the  same  limitations  and  restrictions 
listed  for  MSSend. 

MSPut.  This  submodule  Is  a  task  and  Is  called  by  a  user  submodule  to  send 
a  message  to  another  submodule  In  the  same  subsystem.  M$Put  works  In 
exactly  the  same  way  as  does  MSSend  and  Is  subject  to  the  same  limitations 
and  restrictions. 

*  MSGet.  The  M$Get  submodule  Is  a  task  and  Is  called  by  a  user  submodule  to 
receive  a  message  from  another  submodule  In  the  same  subsystem.  MSGet 
works  In  exactly  the  same  way  as  does  MSRecelve  and  Is  subject  to  the  same 
limitations  and  restrictions. 

FILE  PROCESSOR.  The  File  Processor  module  Is  responsible  for  controlling 
access  to  all  system  files  by  all  user  modules  In  the  Simulation  subsystem. 
Mhlle  the  host  operating  system  will  provide  the  actual  primitive 
»  functions,  the  File  Processor  will  provide  a  high  level  Interface  between 
user  requests  and  the  host  operating  system.  This  protocol  Is  deemed 
necessary  to  ensure  reasonable  and  prudent  access  to  files  and  to  preserve 
the  data  used  and  collected  by  the  system  that  resides  In  these  files.  The 
various  submodules  that  embody  the  File  Processor  are  described  below. 
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F<In1t.  The  Ftlnlt  submodule  Initializes  all  data  areas  and  variables 
local  to  the  File  Processor.  It  opens  the  system’s  ACCESS  CONTROL  file  and 
builds  the  file  ACCESS  CONTROL  TABLE. 

Create.  This  submodule  creates  a  file  name  by  the  caller  and  enters  Its 
name  and  access  parameters  Into  the  file  ACCESS  CONTROL  TABLE.  Unless 
deleted,  the  created  file's  access  parameters  will  become  a  permanent  part 
of  the  system  ACCESS  CONTROL  file.  Create  will  return  a  code  signifying 
success  or  failure. 

Delete.  This  submodule  deletes  a  file  name  by  the  caller  and  removes  Its 
name  and  access  parameters  from  the  file  ACCESS  CONTROL  TABLE.  Delete  will 
return  a  code  signifying  success  or  failure. 

Open.  The  Open  submodule  opens  an  existing  file  for  the  Indicated  opera¬ 
tion  If  the  caller  has  the  correct  access  rights.  Open  assigns  a  file 
descriptor  and  marks  the  file  as  In  use  In  the  FILE  ACTIVE  TABLE.  Only  one 
user  may  open  a  file  for  write  or  update,  while  any  number  of  users  may 
read  from  an  open  file.  Open  returns  an  indication  of  success  or  an  error 
code  If  the  file  does  not  exist  or  the  caller  does  not  have  access 
privileges. 

Close.  This  submodule  closes  an  existing  file  only  If  all  other  users  have 
closed  It.  If  a  file  Is  In  use  by  more  than  one  user,  the  call  to  Close 
only  "closes"  the  caller's  access  to  the  file.  This  protocol  Is  required 
to  prevent  the  owner  or  original  requestor  from  causing  serious  problems  If 
they  attempt  to  close  the  file  before  other  modules  are  finished  with  It. 
If  successful.  Close  releases  the  file  descriptor  and  removes  the  file  from 
the  FILE  ACTIVE  TABLE.  It  returns  an  Indication  If  the  file  Is  not  open  or 
the  caller  does  not  have  access  privileges. 

Acl.  The  Acl  submodule  Is  responsible  for  setting  the  calling  module's 
TTTe  access  privileges  as  Indicated.  Access  rights  are  defined  as: 

0  -  owner,  may  do  anything  to  the  file; 

R  -  read  access  Is  allowed; 

U  -  write  (update)  access  Is  allowed. 

An  asterisk  (*)  In  any  field  signifies  a  "don't  care”  condition.  Only  the 
owner  of  a  file  may  call  Acl  at  any  time  to  change  any  or  all  of  the  access 
parameters. 

Getc.  Getc  Is  called  by  a  user  submodule  to  read  a  single  character  from 
the  specified  file.  This  Is  normally  used  for  console  I/O.  Getc  will 
return  file  not  open  and  end  of  file  conditions. 

Putc.  Putc  writes  a  single  character  to  the  specified  file.  Putc  Is 
Aorially  used  for  console  I/O.  Putc  returns  file  not  open  and ‘end  of 
medium  conditions. 
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Position.  The  Position  submodule  Is  called  by  a  user  module  to  position 
the  file  pointer  associated  with  the  specified  file  to  the  record  or  byte 
Indicated.  Position  can  only  be  used  with  direct  access  files  and  returns 
file  not  open,  end  of  file,  and  not  a  direct  access  file  condition. 

Read.  This  submodule  will  read  the  next  or  the  n-th  record  from  the 
specified  file.  The  next  record  will  be  read  from  a  sequential,  random 
access,  or  stream  file.  The  n-th  record  can  be  read  only  from  a  random 
access  file.  Read  returns  file  not  open,  access  not  allowed,  end  of  file, 
and  not  a  direct  access  file  conditions. 

Write.  The  Write  submodule  writes  to  a  file  and  returns  the  same  condl- 
tlons  as  Read  does  except  that  end  of  medium  replaces  end  of  file. 

Rdblk.  The  Rdblk  submodule  Is  responsible  for  performing  block  I/O  on  the 
specified  file.  Data  are  read  from  the  file  In  large  chunks  equal  to  the 
smallest  physical  addressable  quantity  of  the  file's  medium.  Rdblk  reads 
the  n-th  block  from  the  specified  file.  The  caller  must  update  the  block 
pointer  and  supply  buffer  space.  Rdblk  returns  the  same  conditions  as  does 
Read  except  for  not  a  random  access  file. 

Wrblk.  Wrblk  writes  to  the  specified  file  in  the  same  way  as  Rdblk  reads 
from  the  file.  Wrblk  returns  the  same  conditions  as  Rdblk  except  that  end 
of  medium  replaces  end  of  file. 

Rdllne.  The  Rdllne  submodule  reads  the  next  line  of  data  from  the 
specified  file.  A  line  of  data  Is  defined  as  a  sequence  of  ASCII  bytes 
terminated  by  a  <NUL>,  <LF>,  <FF>,  or  <CR>.  Lines  may  be  any  length  dp  to 
255  characters.  Rdllne  returns  the  length  of  the  line  and  conditions 
Indicating  line  too  long  or  end  of  file. 

Wrllne.  This  submodule  writes  a  line  of  data  to  the  specified  file  as 
dOsdrlbed  for  Rdllne.  The  same  conditions  are  returned  except  that  end  of 
medium  replaces  end  of  file. 

Rdbyte.  The  Rdbyte  submodule  reads  COUNT  bytes  from  the  specified  file. 
If  COUNT  bytes  are  not  available,  COUNT  will  be  set  to  the  number  of  bytes 
actually  read.  Rdbyte  returns  end  of  file  and  file  not  open  conditions. 

Wrbyte.  This  submodule  writes  COUNT  bytes  to  the  specified  file  as  des¬ 
cribed  for  Rdbyte  except  that  end  of  medium  replaces  end  of  file. 


DATA  MANAGEHENT.  This  module  provides  all  the  functions  needed  to  control, 
maintain,  and  update  the  training  and  simulator  data  bases.  The  training 
data  base  consists  of  syllabus  data,  student  record  Information  and  speech 
valeted  data.  The  simulator  data  base  consists  of  all  simulation  data 
related  to  models.  The  Data  Hanagement  module  Is  primarily  an  off-line 
support  program.  All  subsystems  will  use  parts  of  this  module  during  run¬ 
time  to  minimize  development  and  overhead  time  and  to  preserve  the  In- 
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tegrlty  of  the  data  bases.  All  file  access  Is  Implemented  by  calls  to  the 
Simulation  Executive's  File  Processor.  The  submodules  described  below  are 
only  the  very  high  level  ones  used. 

DSInlt.  This  submodule  Is  responsible  for  Initializing  all  local  variables 
and  data  areas  prior  to  any  data  base  accesses. 

DSDeflne.  The  DSDeflne  submodule  Is  called  to  define  a  new  subtree  of  an 
existing  database  schema.  DSDeflne  may  be  used  to  define  subtrees, 
records,  fields,  and  subfields.  This  also  Includes  defining  such  Items  as 
field  size,  key  fields,  formats,  and  range  values.  Since  this  operation  Is 
very  time  consuming.  Its  use  during  run-time  should  be  minimized. 

DSD  1  splay.  This  submodule  Is  used  to  display  portions  of  the  specified 
scnema  including  subtrees.  It  may  be  used  with  any  legal  clause  modifiers 
such  as  WHERE,  AS,  WHEN,  and  UNTIL  and  these  clauses  may  be  modified  by 
conditions  (1.e.  WHERE  pllotjandlngs  >  100). 

DSCreate.  The  D$ Create  submodule  Is  called  to  create  and  Initialize  the 
root  node  or  parent  of  a  database  schema.  This  Includes  the  setting  of  any 
access  parameters. 

DSOpen.  This  submodule  Is  called  to  open  an  existing  schema  file  for 
access  as  described  for  Open. 

DSCIose.  The  DSCIose  submodule  Is  called  to  close  an  open  schema  file  as 
descriped  for  Close. 

DSDelete.  DSDelete  Is  used  to  delete  any  portion  of  a  schema  (subtree, 
record,  field,  subfield)  or  the  entire  schema.  The  use  of  DSDelete  Is 
subject  to  the  restrictions  Imposed  by  access  parameters. 

DSEnter.  This  submodule.  Is  used  to  enter  new  records  (fields,  subfields) 
intb  An  existing  schema. 

DSUpdate.  OSUpdate  Is  used  to  update  records  (fields,  subfields)  In  an 
existing  schema. 


2.3  INSTRUCTIONAL  SUPPORT 

Most  of  the  Information  required  to  explain  concepts  being  demon¬ 
strated  resides  within  the  Instructor  Subsystem.  Outputs  from  the  simula¬ 
tion  Subsystem  to  support  the  explanations  Include  aircraft  state  Informa¬ 
tion  such  as  range,  position,  and  rate  of  position  change.  Some  other 
approach  Information  will  not  be  "known"  by  the  Instructor  Subsystem.  In 
other  words,  some  approach  conditions  may  not  be  explicitly  called  out  by 
the  Instructor  Subsystem  because  of  an  exercise  requirement  for  random 
variability  of  certain  conditions.  Groups  of  conditions  for  which  Simula¬ 
tion  Subsystem  output  may  be  required  Include: 


201 


NAVTRAEQUIPCEN  80-C-0063-2 


o  pilot  characteristics 
o  aircraft  type,  Malfunction 
o  environmental  conditions 
o  operations  conditions 
o  ship  conditions 

o  ISO  workstation  conditions 

However,  the  Instructor  Subsystem  does  not  require  any  output  from  the 
Simulation  Subsystem  to  explain  the  Intent  of  the  exercise  being  generated. 

There  Is  one  area  of  Instructional  support  which  Is  worthy  of  discus¬ 
sion  In  the  context  of  pllot/alrcraft  behavior  model  functions.  There  will 
be  a  requirement  for  (human)  Instructor  Intervention  In  the  generation  of 
exercise  scenarios.  His  judgment  of  trainee  progress  or  performance  may 
lead  him  to  select  specific  variations  In  exercise  scenarios  other  than 
those  called  for  by  syllabus  control.  Thus  there  should  be  Instructional 
support  capabilities  to  enable  this  Instructor  control  flexibility.  The 
impact  of  such  a  capability  Is  that  the  Instructor  Subsystem  should  Incor¬ 
porate  appropriate  control  features  and  the  simulation  model  functions 
should  be  designed  to  respond  to  this  control  flexibility. 


3.0  CONSTRAINTS 

The  purpose  of  this  section  Is  to  describe  the  various  constraints 
which  may  limit  the  capabilities  of  an  automated  LSO  Training  System. 
Constraints  are  discussed  under  two  major  headings:  training  and  system. 
Training  constraints  are  categorized  by  capabilities  and  utilization. 
System  constraints  deal  with  the  constraints  associated  with  the  actual 
Implementation  of  the  software  on  the  hardware  to  provide  the  system. 

3.1  TRAINING 

There  are  several  potential  constraints  on  the  training  effectiveness 
of  an  automated  LSO  training  system.  These  constraints  can  be  separated 
Into  two  groupings,  those  related  to  system  capabilities  and  those  related 
to  utilization  of  the  system. 

One  of  the  potential  constraints  related  to  system  capability  Is  the 

ferformance  quality  of  advanced  technologies  Incorporated  In  the  system, 
he  visual  simulation  Is  one  of  these  technologies.  How  well  It  can  depict 
LSO  task  cues  and  other  simulated  conditions  can  have  a  significant  Impact 
on  training  effectiveness.  However,  at  this  time.  It  Is  not  expected  to  be 
•  technological  problem  area.  Another  potential  constraint  Is  the  perfor¬ 
mance  of  automated  speech  recognition.  Poor  speech  recognition  and/or 
excessive  processing  time  for  speech  recognition  results  could  have  a 
negative  Impact  on  the  effectiveness  of  trainee  task  Interaction  In 
training  exercises.  The  advancement  of  the  status  of  this  technology  Is 
expected  to  be  adequate  to  minimize  concern  in  this  area.  However,  as  of 
this  moment  there  has  not  been  a  successful  demonstration  of  automated 
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speech  recognition  technology  In  a  real-time  application  with  similarly 
critical  timing  requirements.  The  effectiveness  of  automated 
“Intelligence"  within  the  Instructional  control  component  of  the  system  Is 
another  potential  constraint.  One  of  the  goals  of  the  system  Is  to  enhance 
LSO  training  effectiveness  without  Imposing  excessive  burdens  on  the  LSO 
Instructor.  This  technology  should  provide  assistance  for  "Instructor- 
present"  training  sessions  to  enhance  session  efficiency  and  human  Instruc¬ 
tor  effectiveness.  It  should  also  enable  some  amount  of  "Instructor- 
absent"  training.  There  Is  little  doubt  that  the  technology  can  prove 
beneficial  to  LSO  training  effectiveness.  However,  there  Is  some  un¬ 
certainty  for  how  much  of  an  Improvement  In  training  effectiveness  will 
result. 


Even  given  adequate  technology,  there  Is  still  some  uncertainty  for 
how  effectively  some  of  the  system's  functions  will  perform.  Syllabus 
control,  trainee  evaluation  and  scenario  presentation  are  Important  Indivi¬ 
dual  functions  which  can  affect  training  effectiveness.  Equally  Important 
are  the  functional  Interactions  among  these  and  other  system  functions,  as 
well  as  the  human  interfaces  provided  for  system  operations.  The  system 
must  also  be  designed  for  efficient  modification  in  response  to  system 
performance  deficiencies  and  changes  In  LSO  training  requirements. 
Functional  deficiencies  In  any  of  these  areas  can  significantly  constrain 
the  training  effectiveness  of  the  system. 

The  most  capable  training  system  can  fall  far  short  of  desired 
training  effectiveness  through  Ineffective  utilization.  There  are  several 
potential  constraints  on  utilization  effectiveness.  Quality  control  of  the 
training  plan  and  syllabus  associated  with  the  system  Is  one  area  of  con¬ 
cern.  The  training  must  be  continually  monitored,  and  revised  as  necessary 
to  reflect  current  LSO  training  requirements.  Prospective  LSOs  must  be 
given  priority  access  to  the  system  and  Its  training  program.  This  may 
require  multiple  training  locations  for  the  system  and/or  funding  for 
travel.  Command  support  will  be  required  to  minimize  Interferences  to  LSO 
training  resulting  from  other  duties  and  other  training.  Adequate  numbers 
of  instructors  must  be  available  for  the  timely  conduct  of  training. 
Adequate  preparation  of  LSO  Instructors  must  be  provided.  If  Instructor 
and  trainee  attitudes  toward  the  system  are  not  considered  In  the  system 
design,  user  acceptance  will  suffer.  Insufficient  attention  to  these 
factors  mentioned  above  can  Inhibit  effective  system  utilization,  and 
consequently  Its  training  effectiveness. 

In  summary,  LSO  training  system  effectiveness  can  be  affected  by  many 
factors.  Awareness  of  these  human  and  system  factors  and  their  potentially 
negative  Impact  must  exist  throughout  system  design,  development,  and 
Implementation  phases.  This  will  require  their  attention  In  system  capa¬ 
bility  design  and  tradeoff  decisions,  significant  Involvement  of  user 
personnel  In  design  and  development,  thorough  testing  of  system  functional 
and  training  effectiveness,  and  clear  communication  of  system  design  objec¬ 
tives  among  the  various  personnel  disciplines  involved  In  development. 
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3.2  SYSTEM 

This  section  establishes  suggestions  and  guidelines  for  the  various 
software  efforts  Involved  In  the  detailed  design.  Implementation,  testing, 
and  Integration  phases  of  an  LSO  Training  System  project. 

The  primary  objective  of  any  complex  software  development  effort  Is 
that  the  programs  be  developed  In  an  orderly  and  efficient  manner.  A 
secondary  benefit  Is  that  software  developed  be  flexible  and  easily 
maintained.  All  too  often  the  Initial  system  analysis  and  requirements 
definition  phases  are  poorly  done  or  not  done  at  all.  This  results  In 
system  designs  that  are  not  oriented  to  solving  the  problems  at  hand.  This 
Is  one  of  the  most  obvious  system  constraints,  yet  It  is  very  often  over¬ 
looked  or  poorly  understood.  The  following  paragraphs  serve  to  clarify 
procedures  to  follow  to  minimize  potential  development  problems. 

DOCUMENTATION.  Much  has  been  written  about,  and  many  efforts  have  histori¬ 
cally  been  made  to  provide,  adequate  documentation  for  software  projects. 
The  LSO  Training  System  should  emphasize  documentation  In  the  different 
areas  Indicated  below. 

Functional  Design.  The  Functional  Design  is  Intended  to  be  an  Important 
part  of  the  L$0  Training  System  evolution.  It  Is  a  high  level,  function¬ 
ally  oriented  specification  of  the  design  of  the  entire  system.  It  Is 
organized  In  terms  of  the  functions  that  the  system  must  perform  In  order 
to  fulfill  the  requirements  Imposed  by  the  training  objectives.  It 
specifies  the  functions,  their  Inputs,  outputs,  and  the  method  of  Implemen¬ 
tation.  It  Is  Intended  to  serve  as  a  guide  to  future  design  and  Implemen¬ 
tation  for  those  persons  building  the  system.  It  Is  Intended  to  represent 
the  system  design  as  of  the  date  of  publication  of  the  document,  and  to  fix 
It  In  that  state;  any  changes  to  the  overall  design  after  publication 
should  be  the  result  of  necessity  and  not  mere  changes  In  policy. 

System  Interface  Document.  The  sole  function  of  this  document  will  be  to 
ti early  and  accurately  record  the  Interfaces  between  all  software  modules 
and  subsystems  In  the  LSO  Training  System.  It  should  Include  Interfaces 
between  computers  as  well  as  modules  within  a  computer.  The  format  of  the 
System  Interface  Document  should  be  flexible  as  well  as  complete. 

Program  Design  Practices.  The  Program  Design  practices  used  In  developing 
software  for  the  LSb  trainer  should  be  centered  around  the  use  of  what  Is 
commonly  called  "pseudo  code."  Pseudo  code  Is  simply  the  designer's  (and 
programmer's)  specification  of  the  data  structures,  procedures,  and 
algorithms  used  within  a  module  to  fulfill  Its  defined  function.  Pseudo 
code  has  several  distinct  advantages  over  traditional  methods  such  as  flow 
charts  and  string  charts.  First,  It  allows  the  programmer  to  specify  his 
solution  to  the  problem  at  hand  In  a  way  that  Is  close  to  natural  thought 
processes.  This  can  dramatically  speed  the  design  process  alone.  *  Second, 
the  resulting  pseudo  code  can  be  understood  by  non-programmers.  This  Is 
very  Important  for  the  design  review  process  when  It  can  be  very  valuable 
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to  have  the  options  and  constructive  criticisms  of  outsiders  who  may  not  be 
Intimately  familiar  with  all  details  of  the  design  but  who  may  have  had 
similar  design  experiences.  Third,  and  perhaps  most  Important,  the 
resulting  design  can  be  readily  comprehended  by  other  project  programmers 
In  the  event  of  personnel  changes.  This  can  be  of  critical  Importance 
since  many  projects  tend  to  have  problems  due  to  personnel  changes.  While 
pseudo  code  can  be  produced  manually  using  a  text  editor.  It  Is  strongly 
urged  that  a  commercially  available  pseudo  code  processor  be  rchased  for 
use. 

Program  Source  listings.  The  lowest  and  most  detailed  leve  J  software 
documentation ~wlll  be  the  program  listings  themselves.  They  1  serve  as 
the  final  reference  for  any  changes  or  modifications  to  the  s  're.  As  a 
minimum,  each  program  module  listing  should  contain  a  he.  with  the 
following  Information: 

o  The  module  name  If  It  does  not  already  appear  as  part  of  the 
program. 

o  The  name  of  the  principle  author  and  the  date  the  module  was 
first  created. 

o  The  name  of  each  modifying  author  and  the  date  of  each  major 
modification  In  chronological  order  as  well  as  the  nature  of  the 
change. 

o  The  module  calling  sequence  even  If  evident  In  the  code. 

o  A  broad  definition  of  the  module's  function.  This  Includes 
Inputs  and  outputs  not  obvious  In  the  code,  files  referenced, 
external  references,  or  any  other  Information  which  Is  likely  to 
be  needed  by  another  programmer  to  maintain  or  modify  the 
program.  If  this  module  Is  the  main  module  of  a  task  then  this 
section  should  contain  a  detailed  explanation  of  how  the  entire 
task  or  program  functions.  This  should  Include  the  circumstances 
under  which  It  runs,  how  It  communicates  with  other  tasks  or 
modules,  as  well  as  significant  resources  that  It  uses.  It  should 
be  the  program  author's  responsibility  to  see  that  this  section 
contains  all  pertinent  Information. 


GENERAL  PROGRAMMING  STANOAROS.  The  purpose  of  the  standards  and  conven¬ 
tions  described  In  this  section  Is  to  ensure  the  writing  of  "proper 
programs  and  thereby  contribute  to  the  ease  of  testing  and  integration  of 
the  software.  Almost  everyone  In  the  software  field  has  an  Intuitive 
feeling  of  what  constitutes  a  proper  program.  The  following  standards  and 
conventions  are  presented  as  firm  guidelines  and  not  as  unbreakable  rules. 

Modularity.  Programs  will  be  constructed  of  independent  modules  following 
the  single  function  module  concept.  To  the  greatest  extent  possible,  these 
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nodules  will  be  designed  so  that  they  can  be  replaced  or  modified  without 
affecting  other  modules. 

Source  Files.  Each  program  module  should  exist  as  a  separate  file.  This 
should  also  apply  to  "include"  files  if  available  on  the  system.  Files 
should  Include  documentation  specifying  all  modules  that  incorporate  them. 

Comments.  All  comments  should  convey  the  larger  functional  role  of  a 
statement  or  Instruction  or  a  group  of  statements  or  Instructions.  A 
comment  should  not  be  the  translation  of  the  particular  line  of  code  Into 
English.  Any  particularly  obscure  or  complex  section  of  code  should  be 

Preceded  by  a  paragraph  of  comments  explaining  the  Intention  of  that  code, 
n  any  case  there  should  be  sufficient  comments  in  a  module  to  enable  a 
following  programmer  to  finish,  test  and  debug,  or  modify  the  module. 

Self  Hodfying  Code.  Under  no  circumstances  should  self  modifying  code  be 
permitted.  Although  there  may  be  occasions  where  execution  time  and/or 
memory  constraints  or  device  requirements  may  make  self  modifying  code  seem 
attractive.  It  Is  certain  that  Its  use  will  make  testing,  debugging,  and 
maintenance  difficult  If  not  Impossible  (even  by  the  author). 

Shared  Temporary  Storage.  Modules  should  not  share  temporary  storage  among 
themselves.  Sharing  temporary  storage  requires  the  assurance  that  modules 
will  not  conflict  with  each  other.  This  needlessly  compl  :cates  system 
design,  testing  and  debugging,  and  maintenance. 

Local  Data  Items.  Local  data  Items  should  be  defined  In  a  separate  section 
of  the  module  preceding  any  executable  code. 

Entry  Points.  Each  module  should  have  only  a  single  entry  point.  This 
entry  point  should  be  the  first  executable  Instruction  or  statement  In  the 
module. 

Program  Flow.  Modules  should  be  coded  In  such  a  way  that  they  "flow"  down 
the  page,  even  at  the  cost  of  extra  branches  or  jumps.  This  organization 
enhances  the  readability  of  the  listings.  This  guideline  Is  Intended 
primarily  for  non- structured  assembly  language  programs. 

Exit  Points.  All  exits  from  a  module  (or  submodule)  should  occur  through  a 
single  normal,  or  one  alternate  error,  exit  point.  These  exit  points 
should  be  the  last  executable  statements  or  instructions  In  a  module. 

Module  Length.  Each  module  should  be  long  enough  to  perform  a  single 
function!  TFls  should  normally  not  require  over  75  to  100  executable 
statements  or  one  to  two  pages. 

Variable  Names.  All  variables  should  be  explicitly  typed  and  defined.  At 
no  time  should  any  default  data  typing  features  be  used.  Variable  names 
should  be  chosen  to  reflect  or  Indicate  contents  and/or  use  of  the  variable 
as  much  as  possible  within  the  limitations  of  the  programming  language 
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being  used.  Where  severe  limitations  exist  for  variable  name  lengths, 
variable  use  should  be  defined  when  the  variable  Is  defined. 

Reentrant  Code.  If  available  as  part  of  the  vendor  software,  all  routines 
should  be  written  to  be  reentrant.  This  Implies  not  using  declarations 
which  result  In  the  allocation  of  "common",  "own",  or  "equivalence" 
storage. 

Debugging  Measures.  To  the  greatest  extent  possible,  programs  should  be 
written  to  prevent,  or  automatically  detect,  errors  (bugs).  They  should 
Include  measures  to  do  the  following: 

o  Check  the  validity  of  arguments  passed  to  a  module. 

o  Make  range  and  other  reasonableness  checks  on  all  data 

Input  from  outside  the  program. 

o  Check  the  range  of  control  variables  used  In  "CASE" 
statements  or  Its  analogue. 

o  Make  array  subscript  range  checks  If  not  a  compiler 
feature. 

In  some  cases  these  checks  may  require  extra  code,  and  In  some  cases  they 
may  be  accomplished  by  the  use  of  compiler  options.  If  the  checks  require 
additional  code,  this  code  should  be  clearly  marked  as  such  so  that  It  can 
easily  be  removed  after  testing  has  determined  that  the  program  functions 
correctly. 
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APPENDIX  G 

ANALYSIS  OF  CARRIER  LANDING  ACCIDENTS 

A  review  of  carrier  landing  accident  data  for  the  years  1965-1980  was 
conducted  In  order  to  Identify  factors,  variables,  and  trends  within 
accident  situations  which  appear  to  be  particularly  critical  to  successful 
LSO  performance.  The  results  of  this  review  along  with  subsequent  discus¬ 
sions  follow.  The  first  part  of  this  appendix  addresses  overall  trends 
among  recovery  variables  within  carrier  landing  accidents.  The  final 
portion  addresses  trends  of  pilot  behavior  in  approaches  leading  to  carrier 
landing  accidents. 

ACCIDENT  DATA  COMPARISONS  (1965-1980) 

In  order  to  determine  whether  or  not  the  LSO's  role  as  an  accident 
causal  factor  has  become  more  visible  with  the  passage  of  time,  comparisons 
between  three  groupings  of  carrier  landing  accident  data  were  made.  The 
first  set  of  data  resulted  from  an  analysis  performed  by  Dunlap  and  Associ¬ 
ates,  Inc.  covering  accidents  In  the  period  1965-1969.  The  analysis  pro¬ 
vided  an  In-depth  review  of  191  carrier  landing  accidents  during  that 
period  and  grouped  several  accidents  Into  different  categories.  Of  primary 
Interest  to  this  current  study  were  causal  factors  of  these  accidents, 
environmental  factors  and  types  of  landing  accidents.  The  second  group  of 
accidents  was  a  NAVSAFECEN  computer  printout  of  carrier  landing  accidents 
from  July  1970  through  December  1973.  December  1973  was  chosen  as  a 
stopping  point  because  that  time  frame  Is  generally  accepted  as  the  end  of 
combat-type  of  operations  and  It  was  of  Interest  to  determine  what.  If  any, 
trends  developed  after  this  operational  tempo  changed.  The  final  group  of 
landing  accidents  covered  the  period  from  January  1974  to  May  1980,  and  was 
also  In  the  form  of  a  NAVSAFECEN  computer  printout. 

OVERALL  ACCIDENT  TRENDS.  Upon  analyzing  these  three  groups  of  accidents, 
several  commonalities  surfaced.  These  were: 

a.  The  pilot  Is  most  often  listed  as  a  causal  factor. 

b.  More  accidents  happen  at  night  than  day,  even  though  the  number 
of  day  landings  Is  significantly  higher  than  night. 

c.  Undershoots  (ramp  strikes)  and  hard  landings  account  for  the 
greatest  number  of  carrier  landing  accidents. 

d.  When  "other  personnel"  Is  listed  as  a  causal  factor,  the  LSO  Is 
mentioned  more  frequently  than  any  other  type  In  this  category. 


Brlctson,  C.A.,  Pltrella,  F.D.  and  Wulfeck,  J.W.  Analysis  of 
Aircraft  Carrier  Landing  Accidents  (1965-1969),  Technical  Report  tor  or  tile 
of  Naval  Research,  Dunlap  and  Associates,  Inc.,  Santa  Monica,  Ca.  November 
1969. 
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e.  "Combat  area"  was  the  most  frequent  environmental  causal  factor 
In  the  Dunlap  study,  however  It  was  not  addressed  In  the 
printouts.  Considering  this  excluson,  "pitching  deck"  was  listed 
most  often  as  an  environmental  contributing  causal  factor. 

Since  these  commonalities  readily  surfaced,  comparisons  between  the 
groups  were  made  In  these  categories.  The  results  are  given  In  Table  G-l. 


TABLE  G-l.  DATA  COMPARISONS:  CARRIER  LANDING  ACCIDENTS 
(%  of  Total  Carrier  Landing  Accidents) 

July  1965  -  July  1970  -  Jan.  1974  - 
June  1969  Dec.  1973  May  1980 

(N*191)  (N-96)  (N-67) 


CAUSAL  FACTORS: 

Pilot  86.0  71.9  64.2 

LSO  18.8  27.0  31.3 

ENVIRONMENT: 

Night  55.0  54.2  59.7 

Pitching  Deck  12.0  13.5  13.4 

TYPE  ACCIDENT: 

Undershoot  (Ramp  Strike)  28.8  28.1  25.4 

Hard  Landing  63.4  30.2  25.4 


The  most  dramatic  difference  appears  to  be  the  drop-off  In  accidents 
of  the  "hard  landing"  nature.  After  analyzing  the  many  parameters  which 
affect  landing  performance  that  have  changed  during  the  Interval  studied, 
the  study  group  feels  that  this  large  shift  Is  due  to  an  equally  dramatic 
drop  in  landing  approach  speeds  for  fleet  aircraft  (due  to  phase  out  of 
RA-5C  and  F-8).  When  considering  the  change  In  percentage  of  hard  landings 
from  an  LSO  training  standpoint,  one  would  expect  this  statistic  to  also 
reflect  better  results  In  LSO  performance.  However  this  Is  not  the  case, 
as  Is  discussed  later. 


Night,  pitching  deck  and  ramp  strikes  remain  about  the  same  In  regard 
to  percentage  of  total  accidents.  However,  there  are  distinct  differences 
In  the  trends  of  pilots  and  LSOs  as  causal  factors. 

Upon  observation,  the  following  conclusion  Is  reached:  During  the 

ferlods  studied,  the  rate  of  mention  of  the  pilot  as  an  accident  causal 
actor  was  significantly  reduced,  while  The  rate  of  mention  of  the  Lso  as  a 
causal  Tactor  increased.  This  comparison- is  even  more  s1gnl7Tcant  when  the 
following  is  considered.  In  the  Dunlap  analysis,  the  LSO  was  mentioned  as 
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a  causal  factor  If  at  fault  In  either  the  "platform"  (l.e.  waving)  environ¬ 
ment  or  "counseling"  environment.  That  Is,  an  LSO  could  be  held  account¬ 
able  for  an  accident  If  he  had  "failed  to  counsel"  a  pilot  on  a  dangerous 
trend  In  previous  landings,  and  the  same  pilot  later  became  Involved  In  an 
accident.  On  the  other  hand.  In  the  analysis  of  the  NAVSAFECEN  printouts 
In  this  project,  only  the  "platform"  environment  was  considered  when  citing 
the  LSO  as  a  causal  factor  for  the  periods  1970-1973,  and  1974-1980.  The 
trends  established  In  the  above  conclusion  led  the  study  group  to  believe 
there  were  grounds  to  further  analyze  accident  data  to  determine  what.  If 
any,  LSO  training  implications  exist  therein. 

OVERALL  TRAINING  IMPLICATIONS.  Since  accident  narratives  were  not 
Included  In  the  Dunlap  analysis.  It  could  not  be  employed  for  the  In-depth 
analysis  required  to  Identify  any  training  implications  which  could  be 
derived.  The  remaining  accident  data  (1970-1980)  were  examined  in  order  to 
Identify  possible  training  requirements.  It  was  decided  that  of  the 
carrier  landing  accidents  studied,  only  those  In  which  the  LSO  played  some 
role  would  be  considered.  This  eliminated  most,  but  not  all,  "material 
failure"  or  "facility  failure"  type  accidents.  Using  this  criteria,  the 
1970-1973  time  frame  Included  67  accidents;  the  1974-1980  period  Included 
41.  The  same  categories  were  used  for  evaluation  as  In  the  previous 
overall  analysis.  However,  upon  closer  observation.  It  became  apparent 
that  some  sub-categories  could  be  formed  in  order  to  surface  pertinent 
results.  These  sub-categories  were: 

a.  Undershoots.  It  was  found  that  ramp  strikes  could  be  placed  In  one 
of  two  "classic"  types  of  approaches.  The  first  was  a  "come-down"  approach 
In  which  the  aircraft  hit  the  ramp  In  a  downward  motion  from  on  or  above 
glldeslope.  The  second  was  a  low  approach  In  which  the  aircraft  had  been 
below  glldeslope  for  some  time  prior  to  Impact. 

b.  Environment.  Since  "black  night"  or  "no  horizon"  was  of  interest 
from  an  LSO  standpoint.  Its  frequency  of  mention  was  observed. 

c.  Hard  Landings.  Hard  landings  are  the  result  of  one  of  two  occur¬ 
rences:  excessive  sink  rate  or  an  In-flight  engagement  with  a  wire.  Hence 
these  two  sub-categories  are  used  In  this  area. 

d.  LSO  Cause.  The  leading  LSO  cause  In  the  "platform"  environment  was 
"failure  to  dive  a  timely  waveoff".  Within  this  area.  It  was  determined 
that  three  'classic"  approaches  could  be  Identified  during  which  such 
"failures"  occured.  They  were  a  "come  down  at  the  ramp,"  "low  all  the  way" 
and  line-up  deviations.  Additionally,  It  was  possible  to  determine  when 
other  LSOs,  either  back-up  or  supervisory,  were  listed  as  causal  factors. 
It  was  also  considered  apropos  to  examine  the  number  of  times  an  aircraft 
that  had  already  been  waved  off  Incurred  accident  damage  during  the  same 
approach.  With  these  sub-categories  defined,  the  analysis  was  then  con¬ 
ducted.  The  following  results  were  derived  for  the  periods  Indicated. 
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Accidents,  1970-1973. 

Causal  factors.  Of  the  67  accidents  studied,  only  two  left  the  pilot 
completely  blameless.  The  leading  types  of  accidents  In  which  the  pilot 
was  a  causal  factor  were  hard  landings  and  ramp  strikes. 

Type  Accidents.  Twenty-six  of  the  accidents  were  undershoots.  Of  these, 
1/  were  of  the  "come  down*  category.  This  high  rate  of  descent  was  due 
either  to  a  “drop  nose,"  "settle  on  a  line  up  correction"  or  a  significant 
power  reduction.  The  remaining  nine  ramp  strikes  were  of  the  "low  all  the 
way"  variety  and  approached  the  ramp  from  below  glldeslope.  Twenty-eight 
accidents  were  hard  landings.  Twelve  of  these  were  In-flight  engagements, 
and  the  remaining  16  were  due  to  high  rates  of  descent. 

Environment.  Forty-two  of  the  accidents  occurred  at  night.  "Pitching 
deck"  was  mentioned  In  13  of  the  cases,  and  "no  horizon"  or  "black  night 
In  11.  "Combat  area"  factors  were  not  cited  In  any  of  the  narratives,  even 
though  the  time  frame  covers  periods  of  combat  operations. 

LSO  Inputs.  LSOs  were  listed  as  causal  factors  In  26  of  the  accidents.  In 
16  of  the  cases,  the  expression  "failure  to  give  a  timely  waveoff"  was 
employed.  Seven  of  these  Involved  coming  down  "In-close"  or  "at-the-ramp." 
Seven  were  also  "low  all-the-way"  In  nature.  The  remaining  two  were  other 
types  of  judgment  errors. 

Because  of  the  narrative  content.  It  was  possible  to  extract  other 
data  considered  pertinent  to  this  study.  In  an  effort  to  establish  the 
role  the  LSO/pllot  Interface  plays  In  this  area,  a  record  was  made  of  the 
number  of  accidents  In  which  radio  transmissions  from  the  LSO  to  the  pilot 
were  mentioned  specifically  In  the  narratives  of  this  group.  Such 
transmissions  were  recorded  only  If  mentioned  specifically.  That  Is,  no 
Implied  or  expected  transmission  (e.g.  "Roger  Ball")  was  recorded  with  the 
exception  of  an  aircraft  being  waved  off,  in  which  case  It  was  assumed  a 
radio  transmission  accompanied  the  waveoff.  In  this  group,  UHF  trans¬ 
missions  were  mentioned  In  74.6  percent  of  the  accidents.  Eighteen  of  the 
accidents  occurred  after  the  aircraft  had  already  been  given  a  waveoff. 

Considering  only  the  waving  environment,  other  LSOs  were  considered 
causal  factors  In  four  of  the  total  67  accidents.  The  number  of  accidents 
during  MOVLAS  use  was  also  found  to  be  four. 

Other  Considerations.  One  element  that  surfaced  just  by  virtue  of 
frequency  of  mention,  and  therefore  considered  noteworthy,  was  the  fact 
that  In  26  of  the  reports,  the  pilot  had  already  attempted  to  land  at  least 
once  prior  to  the  accident. 

Accidents.  1974-1980. 

Causal  Factors.  Thirty-six  listed  the  pilot  as  a  causal  factor.  Hard 
landings  and  undershoots  were  the  prominent  types  of  accidents  In  which  the 
pilot  was  listed  as  a  causal  factor. 
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Type  accidents.  Fifteen  of  these  accidents  were  undershoots.  Seven  were 
of  the  "come  down"  type*  five  were  "low  all  the  way"  and  three  could  not 
be  determined  from  the  narrative  content.  Hard  landings  were  mentioned  In 
17  of  the  total  group  of  accidents  In  this  time  frame.  Five  were  due  to 
In-flight  engagements*  and  12  Involved  a  high  rate-of-descent. 

Environment.  Thirty-one  occurred  at  night.  Mine  mentioned  pitching  deck. 
"No  horizon”  was  mentioned  In  three  of  the  reports. 

ISO  Inputs.  The  controlling  LSO  was  cited  as  a  causal  factor  In  21  of 
these  accidents.  "Failure  to  give  a  timely  waveoff”  was  listed  In  12 
cases.  Of  these,  four  Involved  a  "come  down  at  the  ramp",  three  were  line¬ 
up  related,  two  were  "low  all  the  way",  two  were  late  waveoff s  and  one  was 
a  Judgment  error.  Other  LSOs  present  were  listed  In  six  of  the  41  mishaps. 
LSO  radio  calls  were  specifically  mentioned  In  10  of  21  reports,  and  14  of 
the  mishap  aircraft  had  already  been  given  a  waveoff.  Three  Involved 
MOVLAS  controlled  approaches. 

Other  Considerations.  Nine  of  the  pilots  Involved  were  making  other  than 
first  attempts  at  landing. 

Conclusions.  Table  G-2  displays  accident  data  in  tabular  format.  Note  that 
the  percentages  presented  are  based  on  accidents  In  which  the  LSO  played  a 
role.  From  observation  of  Table  G-2,  the  following  conclusions  were  drawn: 

a.  In  LSO  related  accidents,  from  1970-1980,  the  rate  of  mention  of 
the  pilot  as  a  causal  factor  decreased,  while  the  rate  of  mention  of  the 
LSO  as  a  causal  factor  Increased.  The  LSO  was  a  causal  factor  In  over  one- 
half  of  these  accidents  from  1974-1980. 

b.  Approximately  seven  In  ten  of  all  landing  accidents  were  either 
ramp  strikes  or  hard  landings. 

c.  The  night  accident  rate  increased. 

d.  The  high  rate  of  mention  for  LSO/pllot  radio  transmissions 
confirms  the  Important  role  of  that  Interface  during  the  landing  environ¬ 
ment. 


e.  Other  LSOs  present  on  the  platform  were  Increasingly  recognized 
as  a  causal  factor. 

f.  MOVLAS  recoveries  were  rare  In  the  accident  scenarios. 

g.  The  classically  dangerous  approaches  Involving  a  "come  down  at 
the  ramp",  or  "low  all  the  way"  play  major  roles  In  ramp  strikes  and  acci¬ 
dents  In  which  LSOs  were  cited  for  failure  to  give  timely  waveoffs. 
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TABLE  6-2.  PERCENTAGES  FOR  LSO  RELATED  ACCIDENTS 


July  1970  -t 
Dec.  1973 
CN-67) 

Jan.  1974 
May  1980 
(N»41) 

PILOT  AS  CAUSAL  FACTOR 

97. OX 

87.81 

NIGHT 

65.7 

75.6 

PITCHING  DECK 

19.4 

22.0 

NO  HORIZON 

16.4 

7.3 

UNDERSHOOTS  (Ramp  Strikes) 

38.8 

36.6 

X  Undershoots:  "Come  downs" 

65.4 

46.7 

X  Undershoots:  "Low  all  the  way" 

34.6 

33.3 

HARD  LANDINGS 

41.8 

41.5 

X  Hard  Landings:  In-Flights 

42.8 

29.4 

*  Hard  Landings:  High  Sink  Rate 

57.2 

70.6 

LSO  AS  CAUSAL  FACTOR 

38.8 

51.2 

LSO  CITED  FOR  "FAILED  TO  GIVE  TIMELY  WAVEOFF* 

'  23.9 

29.3 

X  "Failed  to  Give":  "Come  Downs" 

43.8 

33.3 

X  "Failed  to  Give":  "Low  all  the  way" 

43.8 

25.0 

X  "Failed  to  Give":  Line  up  Deviations 

.0 

16.7 

ALREADY  WAVED  OFF 

26.9 

34.1 

OTHER  LSO  AS  CAUSAL  FACTOR 

6.0 

14.6 

LSO/PILOT  UHF  TRANSMISSION 

74.6 

51.2 

MOVLAS 

6.0 

7.3 

OTHER  THAN  FIRST  PASS 

38.8 

22.0 
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A  trend  established  In  the  analysis  of  overall  accidents  from  1965- 
1980  continued  for  the  LSO  related  accidents  from  1970-1980.  The  pilot 
causal  factor  decreased,  while  the  LSO  causal  factor  Increased  with  the 
cessation  of  combat  activity.  This  would  seem  to  Indicate  that  LSO 
training  became  less  effective  during  the  latter  period.  The  high  rate  of 
failure  to  give  a  timely  waveoff"  mention,  combined  with  the  high 
Incidence  of  ramp  strikes  and  hard  landings  are  Indicative  that  general  LSO 
performance  within  the  "In-close"  portion  of  the  approach  Is  particularly 
critical.  Within  both  the  ■'amp  strike  and  "failed  to  give  waveoff 
categories,  the  "come  down"  hi.  the  most  potential  for  danger.  However,  It 
Is  disturbing  to  note  the  high  Incidence  of  the  "low  all  the  way"  types  of 
approach.  Such  low  deviations  are  unacceptable,  and  such  approaches  should 
be  aborted  by  the  LSO.  Acceptance  of  such  approaches  Is  possibly  Indica¬ 
tive  of  operational  landing  pressures.  In  summary,  high  rate  of  descent  Is 
the  most  visible  parameter  In  ramp  strikes,  hard  landings  and  LSO  "failure 
to  give  timely  waveoff"  situations.  Better  use  of  "power"  and  "attitude" 
calls  could  have  minimized  the  occurrence  of  the  ramp  strike/hard  landing 
outcomes. 

The  criticality  of  the  waveoff  Is  also  reflected  In  the  high  rate  of 
accidents  Involving  aircraft  that  had  already  been  waved  off  (l.e.  aircraft 
waved  off  too  late).  The  rise  In  this  category  may  be  Indicative  of  a 
decrease  In  LSO  ability  to  judge  the  waveoff  window. 

Environmentally,  the  incidence  of  accidents  at  night  and  with  pitching 
deck  showed  slight  Increases.  This  Is  considered  noteworthy  from  an  LSO 
standpoint  because  such  situations  create  the  need  for  closer  LSO/pllot 
Interface,  and  more  refined  LSO  skills.  The  reduction  In  carrier  operations 
and  the  resultant  decrease  In  waving  opportunities  Is  a  likely  Influence  on 
these  trends.  Note  that  although  the  day/night  factor  Is  always  explicitly 
Identified  In  accident  summaries,  other  environmental  factors  may  have 
existed  and  not  been  noted. 

Another  observation  from  this  review  was  an  apparent  deficiency  In 
teamwork  displayed  by  LSOs  on  the  platform.  From  an  analysis  of  these 
accidents,  there  appeared  to  be  a  need  for  more  active  Involvement  bv  the 
backup  LSO,  especially  In  situations  with  difficult  environmental  and 
operational  conditions,  or  with  multiple  approach  deviations  In-close. 

The  low  Incidence  of  MOVLAS  In  accidents  Is  probably  based  on  two 
factors.  First,  MOVLAS  usage  Is  usually  low.  Second,  when  It  Is  In  use  the 
controlling  LSO  Is  usually  very  experienced. 

Finally,  the  frequency  of  accidents  for  aircraft  on  other  than  their 
first  attempts  at  landing  indicates  the  need  for  Increased  LSO  attention  on 
subsequent  passes. 

In  summary,  this  comparative  analysis  provided  empirical  evidence  of 
the  critical  aspects  of  LSO  waving  performance.  It  was  also  concluded  that 
the  trends  of  pilot  behavior  during  carrier  landing  accidents  required  a 
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closer  look.  The  next  section  of  this  appendix  presents  an  analysis  of 
pilot  approach  profile  trends. 


ANALYSIS  OF  APPROACH  PROFILE  TRENDS  (1970-1980). 


Earlier  analyses  addressed  In  this  appendix  addressed  causal  factors 
and  additional  variables  associated  with  carrier  landing  accidents.  Pilot 
approach  trends,  such  as  "high  In  close,  coming  down  at  the  ramp"  and  "low 
ell  the  way,"  were  described  and  their  Implications  to  LSO  training  were 
discussed.  This  subsection  of  the  appendix  describes  a  more  comprehensive 
analysis  of  pilot  approach  trends.  The  results  of  this  analysis  Indicate 
the  frequency  of  various  aspects  of  pilot  behavior  In  carrier  landing 
accidents.  Thus  they  provide  an  empirical  basis  for  the  use  of  pilot 
behavior  modelling  functions  In  an  LSO  Training  System  to  prepare  the  LSO 
for  undesirable  pilot  characteristics  during  approaches. 


This  analysis  was  based  on  the  traditional  LSO  responsibility  for 
analyzing  the  FCLP  and  carrier  landing  trends  of  his  assigned  pilots.  The 
analysis  was  also  Influenced  by  the  author's  familiarity  with  a  NAVTRA¬ 
EQUIPCEN- sponsored  research  project  to  develop  an  Automated  Performance 
Measurement  and  Appraisal  System  (APARTS)  for  pilot  carrier  landing 
training.  NAVSAFECEN  computer  printouts  for  carrier  landing  accidents 
occurlng  between  January  1970  and  May  1980  were  used  In  this  analysis.  LSO 
shorthand  descriptions  of  the  approach  profiles  were  generated  from  the 
accident  narratives  and  recorded  on  a  trend  analysis  worksheet  similar  to 
that  used  by  LSOs.  An  example  Is  depicted  In  Table  6-3.  From  the  accident 
data  available,  102  accident  approaches  were  selected  for  analysis.  The 
only  ones  which  were  left  out  were  those  attributed  strictly  to  material  or 
facilities  failures. 


OVERALL  DEVIATION  TRENDS.  Using  the  descriptive  data  for  accident  ap¬ 
proaches,  an  accountability  was  made  of  pilot  approach  deviations  (l.e. 
nigh,  too  much  rate  of  descent,  lined  up  left).  This  accountability  also 
related  the  deviations  to  the  range  segment  In  which  they  occurred  (l.e.  In 
close,  at  the  ramp).  The  results  of  this  accounting  are  presented  In  Table 
6-4.  The  table  presents  the  percentages  of  deviations  (by  range)  based  on 
the  total  number  of  descriptive  comments  generated  from  the  accident 
narratives.  The  table  also  lists  the  seven  most  frequent  deviations. 

From  this  table,  two  things  are  Initially  evident.  First,  the  large 
majority  of  deviations  Identified  In  the  narratives  occur  In  the  "In  close" 
and  "at  the  ramp"  range  segments.  Secondly,  the  most  frequent  type  of 
deviation  Identified  In  the  narratives  Is  "too  much  rate  of  descent" 
(coming  down),  with  most  of  these  deviations  occurring  "at  the  ramp." 

Brlctson,  C.A.,  Breldenbach,  S.T.  and  Stoffer,  6.R.,  Operational 
Performance  Measures  for  Carrier  Landing:  Development  and  Application, 
Proceedings  of  the  Human  Factors  Society,  24th  Annual  Meeting.  Human 
Factors  Society,  Santa  Monica,  Ca.,  I9BIT 
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CARRIER  LANDING  ACCIDENTS  (N-102  1970-1980 
INDICATE  PERCENTAGE  OF  TOTAL  DESCRIPTIVE  CO 
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Neither  of  these  observations  are  surprising  since  the  terminal  portion  of 
the  approach  Is  known  to  be  the  most  critical  and  the  majority  of  accidents 
are  ramp  strikes  or  hard  landings  caused  by  excessive  sink  rate. 

Upon  closer  observation  It  Is  Important  to  LSO  decision  training  to 
note  that  a  relatively  high  percentage  of  accidents  are  preceded  by  a  high 
glldeslope  deviation  (17%).  Other  general  deviations  which  are  noteworthy 
are  low  glldeslope  (10.9%),  "nose  down"  or  "drop  nose"  (9.6%)  and  "not 
enough  power"  or  "ease  gun"  (6.8%). 

Of  the  specific  deviations  correlated  to  range  (In  the  lower  portion 
of  the  table),  "too  much  rate  of  descent  at  the  ramp”  Is  by  far  the  most 
frequent  (13.2%).  The  next  most  frequently  Identified  deviations  are  "not 
enough  power  in  close"  (6.7%)  and  "high  in  close"  (5.7%).  These  two  devia¬ 
tions  are  related  to  each  other  In  that  a  power  reduction  Is  the  primary 
method  for  correcting  a  high  deviation.  An  excessive  power  reduction  In 
close  also  leads  to  excessive  sink  rate  at  the  ramp,  thus  Indicating  the 
Interrelationships  among  the  three  most  frequent  deviations.  Among  the 
next  most  frequent  deviations  are  "nose  down  In  close"  and  "nose  down  at 
the  ramp”.  These  are  also  precursors  of  excessive  sink  rate  In  close  and 
at  the  ramp.  Other  deviations  of  relatively  high  frequency  are  Indicative 
of  the  Importance  of  a  good  approach  start  and  subsequent  glldeslope 
control  toward  accident  prevention.  These  Include  "low  start",  "too  much 
rate  ofMdescent  In  close,"  "high  start,"  "high  at  the  ramp"  and  "low  In  the 
middle." 

Another  deviation  with  a  relatively  high  frequency  of  occurrence  Is 
excessive  pitch  up  ("pull  nose  up")  approaching  touchdown.  This  was  mostly 
evident  as  an  undesirable  pilot  response  to  the  waveoff.  The  lineup 
deviations  with  the  highest  frequency  Include  "lined  up  left"  and  "drifting 
left."  More  specifically,  "drift  left  at  the  ramp"  has  a  relatively  high 
frequency  of  occurrence. 

DEVIATION  TRENDS  BY  ACCIDENT  CATEGORY.  The  discussion  above  addressed 
overall  deviation  trends  In  carrier  landing  accident  approaches.  The 
analysis  also  focused  on  deviation  trends  within  four  accident  categories: 
ramp  strike,  hard  landing,  In-flight  engagement  and  off-center  landing. 

Ramp  strikes  are  typically  the  most  tragic  of  all  carrier  landing 
accidents.  Analysis  of  ramp  strikes  has  uncovered  some  deviation  trends 
which  can  be  of  use  to  LSO  training.  Table  G-5  presents  the  results  of 
ramp  strike  trend  analysis.  As  the  table  Indicates,  most  of  the  deviations 
occur  In  close  and  at  the  ramp.  The  table  also  Indicates  that  the  primary 
type  deviation  Is  excessive  sink  rate  at  the  ramp  (16.9%),  which  Is  also 
not  surprising.  From  a  closer  look  at  the  data.  It  appears  that  the 
primary  precursor  of  excessive  sink  rate  Is  "not  enough  power  In  close" 
(13.1%).  Other  promising  indicators  of  a  potential  ramp  strike  Include 
"low  start"  (7.5%),  excessive  sink  rate  In  close  (6.9%),  "nose  down  In 
close"  (6.9%)  and  "low  In  the  middle"  (6.3%).  All  the  deviatio.  -  discussed 
thus  far  account  for  over  50  percent  of  the  descriptive  copier's  derived 
from  ramp  strike  accident  narratives. 


ACCIDENTS  (N*0) 
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The  hard  landing  accident  trend  analysis  results  are  presented  In 
Table  6-6.  As  In  the  case  of  ramp  strike  accidents,  most  of  the  deviations 
occur  In  close  and  at  the  ramp.  However,  for  hard  landings,  more  occur  at 
the  ramp  than  In  close,  the  opposite  of  the  frequency  distribution  for  ramp 
strikes.  For  hard  landings,  like  ramp  strikes,  excessive  sink  rate  at  the 
ramp  Is  the  most  prevalent  deviation.  Unlike  the  ramp  strike,  the  primary 
precursors  to  excessive  sink  rate  In  hard  landing  accidents  are  "nose  down 
at  the  ramp"  (6.9%),  "high  In  close"  (8.9%)  and  "high  at  the  ramp"  (8.9%). 
Power  deviations  do  not  appear  as  significant  In  hard  landing  accidents  as 
they  are  for  ramp  strikes.  One  other  deviation,  "high  start"  (6.5%),  mav 
also  be  useful  In  conjunction  with  the  others  as  Indicative  of  a  potential 
hard  landing  accident. 


In  looking  at  accidents  resulting  from  off-center  landings.  It  became 
very  evident  that  the  primary  problem  Is  lineup  deviation  to  the  left.  The 
results  of  off-center  landing  accident  trend  analysis  are  presented  In 
Table  6-7.  Deviations  for  this  type  of  accident  occur  most  frequently  at 
the  ramp  and  on  touchdown.  By  far  the  most  prevalent  deviation  Is  a  "drift 
left  on  touchdown"  (17.8%).  Next  In  frequency  are  "drift  left  at  the  ramp" 
(8.9%)  and  "land  left"  (8.9%).  What  is  disturbing  about  the  deviations 
mentioned  so  far  Is  that  they  occur  near  or  past  the  point  where  the  LSO 
can  Initiate  a  safe  waveoff.  The  data  derived  from  the  accident  narratives 
did  not  Indicate  the  presence  of  very  many  cues  which  could  help  the  LSO 
prevent  these  off-center  landing  accidents.  The  Implication  to  LSO 
training  appears  to  be  that  an  LSO  must  be  critically  alert  for  the  least 
Indication  of  lineup  control  Instability  approaching  the  waveoff  decision 
point  In  order  to  preclude  this  type  of  accident.  This  problem  also  points 
to  the  Importance  of  the  backup  LSO,  especially  when  the  controlling  LSO  Is 
faced  with  other  simultaneous  approach  deviations. 


The  final  category  of  carrier  landing  accidents  which  were  analyzed 
were  In-flight  engagements.  Results  of  this  analysis  are  presented  In 
Table  G-8.  Most  of  the  deviations  In  this  type  of  accident  occurred  In 
close  and  at  the  ramp.  However,  the  most  prevalent  deviation  was  "pull 
nose  up  on  waveoff  or  approaching  touchdown"  (18.4%).  The  most  frequent 
precursors  to  this  deviation  were  "too  much  rate  of  descent  at  the  ramp" 
(14.3%),  "too  much  rate  of  descent  in  close"  (6.1%)  and  "not  enough  power 
in  close"  (6.1%).  As  mentioned  earlier,  most  of  the  In-flight  engagement 
accidents  occurred  during  waveoff.  The  sink  rate  and  power  deviations  were 
probably  the  cues  which  led  to  Initiation  of  waveoffs.  The  Implications  to 
LSO  training  Is  that  the  LSO  must  learn  to  factor  the  possibility  of  pilot 
waveoff  technique  Into  his  waveoff  decision. 
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SUMMARY.  In  terms  of  deviation  trends  within  carrier  landing  accidents, 
excessive  sink  rate  "at  the  ramp"  must  be  of  prime  concern  to  the  ISO  and 
to  LSO  training.  Deviations  which  most  frequently  precede  the  excessive 
sink  rate  problem  Include  "not  enough  power  In  close"  (frequently  a  pre¬ 
cursor  to  a  ramp  strike),  "high  nose  down  at  the  ramp"  (frequently  a 
precursor  to  a  hard  landing),  'high  In  close"  and  "nose  down  In  close." 
These  are  prime  cues  to  the  LSO  that  he  should  strongly  consider  a  waveoff 
If  an  accident  Is  to  be  prevented.  Unfortunately  these  cues  occur  very 
late  In  the  approach,  near  the  waveoff  decision  point.  Poor  starts  (high 
and  low)  and  poor  glideslope  control  early  In  an  approach  are  also  cues  to 
the  LSO  to  be  alert  for  glideslope  control  and  other  problems  approaching 
the  waveoff  decision  point. 

Most  of  the  lineup  problems  with  which  an  LSO  must  contend  In  poten¬ 
tial  accident  situations  are  associated  with  "lined  up  left"  and  "drifting 
left,"  particularly  approaching  the  ramp.  They  often  occur  with  little 
warning  and  with  little.  If  any,  spare  time  for  Initiating  a  waveoff.  The 
frequency  of  the  "pull  nose  up"  problem,  which  usually  occurs  on  a  waveoff, 
must  be  an  Influencing  factor  for  the  LSO  in  his  waveoff  decision  process. 
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APPENDIX  K 

LSO  TRAINING  MODEL  MANAGER  AND  NAVAL  SAFETY  CENTER  INTERFACE 

The  current  relationship  between  the  TMM  and  the  Safety  Center  was 
studied  In  order  to  determine  whether  there  was  a  need  for  Improving  the 
flow  of  communications  between  them.  Such  a  need  does  In  fact  exist.  The 
background  for  this  requirement,  along  with  accompanying  recommendations 
follow. 

CURRENT  NAVSAFECEN  DATA 

The  primary  source  of  Information  that  the  NAVSAFECEN  uses  for 
analysis  purposes  Is  the  Mishap  Investigation  Report  (MIR)  generated  for 
each  accident.  The  procedures  for  compiling  this  report  are  described 
below,  along  with  a  summary  of  the  NAVSAFECEN  analysis  of  such  data. 

MISHAP  REPORTING  PROCEDURES.  Current  procedures  require  that  the  custodian 
(e.g.  squadron)  of  an  aircraft  Involved  In  an  accident  submit  a  preliminary 
report  that  briefly  describes  the  circumstances  surrounding  the  mishap.  An 
Aircraft  Mishap  Board  (AMB)  Is  then  convened  which  performs  an  exhaustive 
analysis  of  the  events  that  occurred  before,  during  and  after  the  accident, 
as  well  as  addressing  the  need  for  material  analysis  of  equipment  Involved. 
The  AMB  then  Issues  a  final  Mishap  Investigation  Report  (MIR)  which  details 
the  analysis  performed,  lists  empirical  data  (aircrew  names,  date,  weather 
conditions,  etc.)  and  determines  the  causal  factors  of  the  accident.  The 
MIR  Is  then  forwarded  up  the  chain  of  command  from  the  custodian  unit  to 
the  cognizant  type-commander  (CNAL,  CNAP,  etc).  Each  level  of  the  chain 
of  command  has  the  opportunity  to  endorse  the  board's  findings  and  any 
accompanying  recommendations.  The  type-commander  then  adds  an  endorsement 
and  forwards  the  report  to  NAVSAFECEN,  where  the  Commander,  NAVSAFECEN 
makes  a  final  decision  regarding  the  accident's  causal  factors  and  employ¬ 
ment  of  associated  recommendations.  The  MIR  Is  routed  to  NAVSAFECEN  data 
processing  where,  using  400  different  coding  possibilities,  the  Information 
contained  within  Is  entered  Into  the  center's  computer  storage  banks.  The 
hard  copy  of  the  MIR  Is  kept  for  18  months,  after  which  It  Is  transferred 
to  microfiche.  The  coding  for  data  entry  consists  mostly  of  empirical 
data.  Such  data  needs  to  be  called  out  by  code  In  order  to  be  listed  on 
any  computer  printout  for  subsequent  trend  analysis.  A  narrative  or  brief 
description  of  each  accident  is  Included,  however,  there  Is  not  a  standar¬ 
dized  format  for  this  narrative's  construction  or  content.  If  Information 
regarding  LSO  related  accidents  Is  desired  for  trend  analysis,  the  coding 
"carrier  landing  accidents"  can  be  used.  To  be  even  more  specific,  a 
computer  printout  of  empirical  data  can  be  generated  according  to  the  code: 
"Fixed  wing,  embarked,  landing  phase  of  operation."  Such  a  printout 
supplies  the  following  Information  automatically: 

a.  Data  period  (time  Interval)  covered 

b.  Model  aircraft 

c.  Damage 

d.  Date 
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e.  Day/night 

f.  CV  name/number 

g.  Causal  factors 

n.  Type  of  alshap 

1.  Injuries 

j.  Mishap  narrative 

The  narrative  nay  or  may  not  Include  environmental  conditions,  ISO 
actions  or  other  Information  considered  Important  from  an  LSO's  point  of 
view.  Such  Information  must  be  specifically  requested  by  code  from  the 
Safety  Center.  Physical  evidence,  when  considered  pertinent.  Is  retained 
by  the  type  commander. 

ANALYSIS.  The  only  routine  landing  analysis  performed  at  the  NAVSAFECEN  Is 
a  quarterly  report  which  categorizes  landing  mishaps  by  period  of  day 
(day/nlght).  This  Is  forwarded  to  the  statistics  section  where  It  Is 
stored  for  reference  purposes.  Any  other  type  of  analysis  must  be  specifi¬ 
cally  requested  from  NAVSAFECEN  data  processing  using  the  appropriate  code. 
Several  studies  of  accident  Information  have  been  performed  by  members  of 
the  NAVSAFECEN  staff  In  order  to  determine  If  any  trends  surface  as  a 
result  of  accident  data  analysis.  Examples  of  such  trend  analysis  are  the 
correlation  between  accident  rate  and  pilot's  time- In- type,  and  the  number 
of  hard  landings  associated  with  a  particular  type  of  aircraft. 

The  capability  exists  for  Interested  parties  with  a  need-to-know  to 
receive  computer  printouts  of  desired  accident  data  by  requesting  such 
Information  from  the  NAVSAFECEN.  This  request  can  be  made  by  letter  with 
the  reason  for  the  request  (e.g.  Navy  training  course  support,  study  under 
government  contract)  stated  within. 

PHASE  ONE  SCHOOL  ACCIDENT  INFORMATION 

At  present  no  accident  data  Is  being  forwarded  as  a  matter  of  course 
to  the  LSO  Training  Model  Manager  (TMM)  at  the  Phase  One  School.  Such  data 
can  be  forwarded  if  It  Is  specifically  requested.  However,  the  LSO  TMM 
does  maintain  a  close  Informal  liaison  with  the  type-commander  LSOs . 
Should  he  become  aware  of  an  LSO  related  accident.  It  Is  not  unusual  for 
the  LSO  TMM  to  establish  phone  contact  with  the  staff  LSO  and  obtain 
Information  considered  useful. 


RECOMMENDATIONS 

The  following  recommendations  are  listed  in  order  to  provide  suggested 
courses  of  action  that  might  Improve  fleet  LSO  training. 

NAVSAFECEN  AND  LSO  TMM  INTERFACE.  In  the  course  of  analyzing  accident  data 
for  this  report,  the  study  group  found  that  several  training  Implications 
can  be  gleaned  from  comprehensive  accident  review.  There  is  no  doubt  that 
the  LSO  TMM  and  his  staff  could  find  a  similar  use  for  the  same  data. 
Therefore,  If  It  Is  possible  to  Initiate  automatic  forwarding  of  accident 
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data  fro*  the  NAVSAFECEN  to  the  LSO  TMM,  the  administrative  steps  necessary 
to  accomplish  such  an  Interface  should  be  undertaken.  Such  an  automatic 
forwarding  process  should  exist  for  accidents  that  meet  the  following 
criteria:  MAJOR  CV  LANDING  ACCIDENTS  FIXED  WING.  Presently,  accident  data 
considered  pertinent  to  fleet  units  (e.g.  because  of  aircraft  model)  Is 
forwarded  to  such  units.  This  Includes  preliminary  and  final  MIRs.  In 
like  manner,  accidents  that  meet  the  above  stated  criteria  could  be  sent  to 
the  LSO  TMM.  Involving  the  LSO  TMM  in  the  endorsement  process  for  such 
accidents  should  also  be  considered.  His  comments  as  a  "training"  endorser 
would  be  most  beneficial  to  fleet  LSOs. 

What  the  LSO  TMM  Needs  to  Know.  In  order  for  the  LSO  TMM  to  perform  a 
Rieanl ngTuT“ahaTys1  s  of  “accl dent  data ,  the  following  information  should  be 
made  available  to  him  for  every  carrier  landing  mishap. 

a.  Aircraft  type 

b.  Period  of  day 

c.  Approach  results  (ramp  strike.  In-flight  engagement,  etc.) 

d.  Pilot's  hours:  total,  and  In-type 

e.  Pilot's  history  of  carrier  landings  (last  7/30/90  days,  total 
CV  landings  and  total  In  type) 

f.  Flight  deck  pitch  and/or  roll.  If  applicable;  flight  deck  trim 

g.  Status  of  landing  aids 

h.  Barricade  arrest  If  applicable 

I.  Speed  and  relative  direction  of  wlnd-over-the  deck 

J.  Celling,  visibility  and  whether  or  not  precipitation  was 
present.  Horizon  definition. 

k.  Any  facility  or  aircraft  malfunction  present 

l.  Aircraft/facility  damage 

m.  Divert/tanker  assets  available 

n.  Type  of  operations  ( CNATRA/RAG  CQ,  refresher  CO,  fleet  ops,  etc.) 

o.  A  comprehensive  narrative  of  the  accident,  to  Include  all  voice 
transmissions,  aircraft  position,  speed  and  attitude  during  the 
defined  LSO  stages  of  the  approach  (In-the-mlddle,  In-close, 
etc.),  and  all  LSO  grading  comments.  Previously  established 
trends  of  the  pilot  should  also  be  Included. 

The  Ideal  situation  would  be  for  someone  In  the  accident  Investigation 
process  to  fill  in  such  a  checklist  with  the  appropriate  data  for  each 
mishap.  At  the  time  nearly  all  of  this  Information  Is  available  In  various 
parts  of  the  MIR.  A  brief  description  of  where  such  data 
is  recorded  follows. 

Available  MIR  data.  OPNAV  For*  8750/1  Is  a  summary  form  used  by  Accident 
Mishap  Boards  to  simplify  the  report  and  enable  statistical  recording  of 
pertinent  data.  The  following  Items  should  be  extracted  from  this  form  and 
forwarded  to  the  LSO  TMM: 

a.  Narrative  description  of  the  accident 

b.  Model  aircraft 

c.  Period  of  day 
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d.  Flying  experience  (pilot's) 

t.  Cause  factors 

f.  Environmental  conditions 

g.  Optical  glldeslope  devices  available 

!i.  Arresting  equipment  utilized 

1.  Damage  to  aircraft 

In  addition  to  this  Information,  the  following  Information  from  the 
MIR  should  also  be  Included  from  the  "account"  portion  of  the  formal  MIR. 

a.  From  "Support  Personnel  Factors:"  The  evaluation  of  the  physiologi¬ 
cal  and  psychological  status  of  the  LSO(s)  and  his  (their)  role  In  the 
mishap. 

b.  From  “Facilities:"  The  use  and  status  of  the  ISO  platform  dis¬ 
plays  and  other  landing  aids  as  an  Influence,  favorable  or  unfavorable,  on 
the  accident. 

c.  From  statements  "by  the  controlling  LSO  and  senior  LSO:"  A  com¬ 
plete  account  of  the  accident  from  the  LSO  viewpoint  (Including  grade  and 
LSO  comments  from  LSO  log);  an  analysis  of  the  pilot's  LSO  graded  landings 
for  the  previous  30  days;  and  Items  as  required  by  Section  VIII  (Aircraft 
Mishap  Statement  Considerations)  of  the  LSO  NATOPS  Manual. 

Additionally,  If  at  all  possible,  time  correlated  transcriptions  of 
LSO-pIlot  voice  tapes,  and  copies  of  PLAT  video  tapes  should  be  included. 

The  sensitivity  of  accident-related  data  Is  greatly  appreciated  and 
should  remain  Intact.  The  LSO  TMM  should  not  be  so  much  Interested  In  the 
WHO  of  the  accident,  but  rather  what  the  LSO  did  or  could  have  done  to 
affect  Its  outcome.  There  seems  to  be  no  reason  to  believe  that  any 
compromise  of  sensitive  Information  would  occur  If  only  the  Items  listed 
are  Included  In  the  forwarded  data. 

TMM  DATA  USAGE.  What  follows  Is  a  description  of  how  accident  data  des¬ 
cribed  above  could  be  used  to  assist  the  LSO  TMM  In  changing  or  developing 
training  objectives  for  the  Phase  I  School  curriculum  and  the  overall  LSO 
training  program. 

Accident  Trend  Analysis.  An  extensive  analysis  of  carrier  landing 
accident  data  Is  provided  In  Appendix  G  of  this  report.  It  was  done  In 
order  to  determine  what  trends  might  surface  as  regards  types  of  approaches 
and  LSO  actions  that  occur  In  major  landing  accidents.  The  authors  group 
believes  that  a  similar  analysis  of  data  for  these  types  of  accidents,  as 
they  occur,  could  be  most  beneficial  to  the  LSO  TMM.  One  measure  of  LSO 
training  effectiveness  Is  the  frequency  of  accidents  in  the  carrier  landing 
environment.  If  the  accident  rate  in  this  regime  rises,  then  one  reason 
could  possibly  be  less  effective  training  In  a  particular  area.  Should 
such  a  discovery  be  made,  the  LSO  TMM  could  act  to  insure  an  appropriate 
training  "alert"  be  promulgated  to  fleet  LSOs  and  incorporated  In  the  Phase 
I  syllabus.  In  short,  accident  data  made  available  to  the  LSO  TMM  as  It 
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surfaces  could  ba  used  as  an  effective  tool  for  "quality  control"  of  fleet 
ISO  training.  In  keeping  with  this.  It  Is  recommended  that  carrier  acci¬ 
dent  landing  data  be  analyzed  to  determine  whether  or  not  the  frequency  of 
accidents  is  decreasing  or  Increasing  with  respect  to  the  following 
categories: 

a.  Pilot  as  a  causal  factor 

b.  Controlling  LSO  as  a  causal  factor 

c.  Other  LSO($)  as  a  causal  factor 

d.  Period  of  day  (day/night) 

e.  Deck  pitch  or  roll;  mlstrlm  of  ship 

f.  Little  or  no  horizon 

g.  Weather  at  or  near  mlnlmums 

h.  Aircraft  already  waved  off 

1.  Types  of  approaches  that  resulted  In  an  accident  Involving  "come¬ 
down  from  a  high",  "low-all -the- way",  and  line-up  deviations. 

j.  Final  result  of  the  approach.  Including  ramp  strike,  hard 
landing.  In-flight  engagement,  and  off-center  engagement.  This  should  be 
coordinated  with  "1."  above  In  order  to  determine  If  there  are  noteworthy 
trends  leading  to  these  results. 

k.  Type  of  OLS  In  use  (e.g.  MOVLAS) 

l.  Pilot's  history.  Including  total  flight  time  and  time  In-type, 
carrier  landings  (total  and  In- type)  and  previously  established  approach 
trends. 

m.  wind  conditions  (high/low  WOD,  crosswind,  etc.) 

n.  Emergency  In  progress  (aircraft  or  facility) 

o.  Operational  situation  (CQ,  no  tanker/divert,  etc.) 

p.  Aircraft  type 


Additionally,  the  LSO  grading  comments  should  be  observed  In  order  to 
determine  the  "starting  point"  of  the  accident.  That  Is,  at  what  point 
(In-the-mlddle,  In-close)  of  the  approach  did  the  aircraft  begin  to  deviate 
from  acceptable  parameters,  and  what.  If  anything,  the  LSO  could  have  done 
to  prevent  these  deviations  from  terminating  In  an  accident. 


NAVTRAEQU1PCEN  80-C-0063-2 


If  such  an  analysis  were  performed,  possible  trends  In  accidents  could 
be  Identified.  For  example,  the  types  of  approach  trends  that  develop  for 
a  new  Inventory  aircraft  (e.g.  F/A-18)  could  be  Identified  and  then  appro¬ 
priate  LSO  actions  defined  to  anticipate  such  trends.  A  rise  In  the  per¬ 
centage  of  accidents  listing  the  LSO  as  a  causal  factor  would  be  a  most 
positive  Indication  that  further  research  Into  LSO  training  was  warranted. 
As  an  example  of  the  usefulness  of  such  data,  consider  a  Flight  Safety 
Advisory  Issued  by  NAVSAFECEN  In  1972.  In  It  accident  data  were  analyzed, 
and  It  was  determined  that  there  was  a  recent  marked  Increase  In  hard 
landing  type  accidents.  The  analysis  defined  exact  reasons  for  such  an 
increase.  These  Included  "In-close  corrections,"  and  "late  line  up  correc¬ 
tions"  In  the  F-4  aircraft.  The  F-4  has  a  tendency  to  develop  an  Immediate 
Increased  sink  rate  should  the  pilot  drop  the  nose  In-close  to  correct  for 
an  above  glldeslope  deviation.  The  result  can  be  a  hard  landing  If  timely 
action  Is  not  taken  by  the  LSO  (e.g.  an  "attitude"  call,  or  waveoff).  This 
fact  surfaced  In  the  F-4  trend  analysis.  Such  a  trend  analysis  could  be 
performed  by  the  LSO  TMM.  His  discovery  of  such  a  fact  would  lead  him  to 
bring  It  up  when  discussing  the  F-4  training  environment,  thus  alertlna 
fleet  LSOs  to  be  ready  to  act  should  an  F-4  "drop  nose  In  close."  Such 
discoveries  could  be  promulgated  In  a  monthly  LSO  newsletter.  Naval 
message  or  Approach  Magazine. 

The  possibility  of  computer  resources  becoming  available  to  the  LSO 
TMM  Is  another  reason  for  funnel  Ing  accident  data  to  him.  Such  an  asset 
could  be  programmed  to  Identify  trends  such  as  those  listed  above  over  a 
period  of  time  In  order  to  assist  the  LSO  TMM  In  keeping  the  fleet 
Informed.  Type  commanders  and  NAVSAFECEN  are  quick  to  act  when  a  dangerous 
trend  In  the  structure  of  an  aircraft  surfaces  and  Is  found  to  cause 
-  accidents.  There  Is  no  reason  why  the  same  prevention  philosophy  cannot  be 
applied  to  the  LSO  community  In  order  to  prevent  future  accidents. 
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ACRONYMS 


AMB 

Aircraft  Mishap  Board 

AOA 

Angle  of  Attack 

ACLS 

Automatic  Carrier  Landing  System 

ARCS 

Automatic  Power  Compensation  System 

B/U 

Backup 

CARS 

Carrier  Aircraft  Recovery  Simulator 

CCA 

Carrier  Controlled  Approach 

COMNAVAIRLANT 

Commander  Naval  Air  Forces  Atlantic  Fleet 

COMMA VA1RP AC 

Commander  Naval  Air  Forces  Pacific  Fleet 

CQ 

Carrier  Qualification 

CV 

Aircraft  Carrier 

DLC 

Direct  Lift  Control 

OR 

Drift  Rate 

EMCON 

Electronic  Emission  Control 

FCLP 

Field  Carrier  Landing  Practice 

FLOLS 

Fresnel  Lens  Optical  Landing  System 

GS 

G11  deslope 

HUD 

Head  Up  Display 

LSO 

Landing  Signal  Officer 

LSORO 

LSO  Reverse  Display 

LSO  TMM 

LSO  Training  Model  Manager 

LSOTS 

LSO  Training  System 

LU 

Lineup 

MIR 

Mishap  Investigation  Report 

MOVLAS 

Manually  Operated  Visual  Landing  Aid  System 

NAS 

Naval  Air  Station 

NATOPS 

Naval  Air  Training  and  Operating  Procedures 
Standardization 

NAVTRAEQUIPCEN 

Naval  Training  Equipment  Center 

NCLT 

Night  Carrier  Landing  Trainer 

NOROO 

No  Radio 

OJT 

On  the  Job  Training 

OLS 

Optical  Landing  System 

OR 

Operational  Requirement 

PE 

Performance  Evaluation 

PLAT 

Pilot  Landing  Aid  Television 

PM 

Performance  Measurement  (or  Monitor) 

SR 

Sink  Rate 

SUS 

Speech  Understanding  System 

MOO 

Mind  Over  Deck 
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